de-project-bentley/src, branch main Northcoders project - ETL pipeline with AWS http://git.ajschof.me/de-project-bentley/atom?h=main 2024-09-03T15:07:37Z Merge branch 'development' into test/tests_transform_lambda 2024-09-03T15:07:37Z Alex git@ajschof.me 2024-09-03T15:07:37Z urn:sha1:ce30178558cc8222e9975273eb5d08a93ae92fcc Merge pull request #107 from ajschofield/feat/dataframes 2024-08-29T08:59:21Z bulve-ad 78788030+bulve-ad@users.noreply.github.com 2024-08-29T08:59:21Z urn:sha1:25dc9cc19a3667f4c1f79ea0f16a16c713b1f478 pr: working load lambda when no data is present in the warehouse style: format code with Autopep8, Black and Ruff Formatter 2024-08-29T08:57:48Z deepsource-autofix[bot] 62050782+deepsource-autofix[bot]@users.noreply.github.com 2024-08-29T08:57:48Z urn:sha1:42ad135b25044bb1c7ab8a553f038c8da9de0f75 This commit fixes the style issues introduced in 48e7dae according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/107 fix: added comma. Code complete and uploads all tables in one go if no data exists per each table 2024-08-29T08:47:58Z Ang Bel anzelikabelotelova@Anzelikas-MacBook-Air.local 2024-08-29T08:47:58Z urn:sha1:48e7daec8b5435a696fe572fd51dcbc8f9604a2d fix: adds missing dataframes and resolves tables upload to end data warehouse in case the table is empty 2024-08-28T21:46:00Z Ang Bel anzelikabelotelova@Anzelikas-MacBook-Air.local 2024-08-28T21:46:00Z urn:sha1:d396cd95d660fb76188ef887fc268d20aeeb5352 wip commit 2024-08-28T16:52:45Z T-Aji tolujbd2@gmail.com 2024-08-28T16:52:45Z urn:sha1:6235a2bb04b60d57a41196b07bbf0296920c6980 wip finished testing the process and upload parquet 2024-08-28T13:59:05Z lian-manonog lian.manonog@gmail.com 2024-08-28T13:59:05Z urn:sha1:fadc54b7f72eca1eccbb9f4e7bb8ffca0960ebfa debugging load_lambda 2024-08-28T13:39:13Z T-Aji tolujbd2@gmail.com 2024-08-28T13:39:13Z urn:sha1:d064b2ec2c7393f8de50560a7edfe100851bfea3 refactored functs to include columns instead of drop columns 2024-08-28T11:48:13Z T-Aji tolujbd2@gmail.com 2024-08-28T11:48:13Z urn:sha1:03a5959df25f74d52ed5393c2a5af6b1b9eb34c9 style: format code with Autopep8, Black and Ruff Formatter 2024-08-28T10:51:00Z deepsource-autofix[bot] 62050782+deepsource-autofix[bot]@users.noreply.github.com 2024-08-28T10:51:00Z urn:sha1:bf55c50ed6228eb1ca3b10e7280ed35944f7f42f This commit fixes the style issues introduced in 6c85677 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/106