de-project-bentley/src/extract_lambda.py, branch main Northcoders project - ETL pipeline with AWS http://git.ajschof.me/de-project-bentley/atom?h=main 2024-08-22T11:33:00Z fix: improve error handling for list_existing_s3_files and tests 2024-08-22T11:33:00Z Alex Schofield git@ajschof.me 2024-08-22T11:33:00Z urn:sha1:053e75bca8ef34a655bb4afda5f479f112dfb002 fix: handle no buckets properly 2024-08-22T11:27:55Z Alex Schofield git@ajschof.me 2024-08-22T11:27:55Z urn:sha1:dc7dfe29ce977f3038fb3affd617683e8f163dc8 fix: change default parameters for bucket_name and client 2024-08-22T11:03:38Z Alex Schofield git@ajschof.me 2024-08-22T11:03:38Z urn:sha1:82a835363953538e506f91eb3199d835f0624975 feat: add more logging for debugging 2024-08-20T14:15:02Z Alex Schofield git@ajschof.me 2024-08-20T14:15:02Z urn:sha1:2a914add8391f345ee1096b9deb729c05d3e06c3 refactor: change rows output to debug logger output 2024-08-20T10:49:59Z Alex Schofield git@ajschof.me 2024-08-20T10:49:59Z urn:sha1:be911e22a964bdf7d5a4421cde7d7c6df447ed5c feat: add additional logging and exclude unnecessary table 2024-08-20T10:44:30Z Alex Schofield git@ajschof.me 2024-08-20T10:44:30Z urn:sha1:35397e8bad42a8c507d1fb13007c6da2f947e851 feat: add advanced logging 2024-08-20T10:31:25Z Alex Schofield git@ajschof.me 2024-08-20T10:31:25Z urn:sha1:dc3a7e74ddf549dad05745c64201aaf0d3402213 feat: conditional logic for if bucket is empty 2024-08-20T10:26:26Z Alex Schofield git@ajschof.me 2024-08-20T10:26:26Z urn:sha1:5211751b69a894874945e3a916c33781a327ab10 feat: revert s3 streaming to previous implementation for uploading 2024-08-20T10:01:55Z Alex Schofield git@ajschof.me 2024-08-20T10:01:55Z urn:sha1:e25bee6c1c9db8edaf3197f0dc48fa3c63e61744 fix(extract_lambda): fix UnboundLocalError when db is called before it is assigned a value 2024-08-19T23:18:16Z Alex Schofield git@ajschof.me 2024-08-19T23:18:16Z urn:sha1:640b0685cd795c03b571b3ca26fc9030b86c4f99