de-project-bentley/requirements.txt, branch development Northcoders project - ETL pipeline with AWS http://git.ajschof.me/de-project-bentley/atom?h=development 2024-08-27T10:08:06Z Merge branch 'development' into feature/load-lambda 2024-08-27T10:08:06Z Ellie 167526066+ellsymonds@users.noreply.github.com 2024-08-27T10:08:06Z urn:sha1:182ba54c0c340a4819bb7400f6eb204e15364387 add SQLalchemy to requirements 2024-08-23T10:18:55Z Ellie ecsymonds@gmail.com 2024-08-23T10:18:55Z urn:sha1:535e3cd919613d4cadfbb42ea8f2ecdd7678f38c add pyarrow to requirements 2024-08-23T08:39:44Z Ellie ecsymonds@gmail.com 2024-08-23T08:39:44Z urn:sha1:a5b4056961ae65b4b2b1fe3afaf1561b2ba749ae wip: wrote pseudocode for lambda handler in writing df to parquet file format and uploading the parquet files 2024-08-22T16:06:45Z lian-manonog lian.manonog@gmail.com 2024-08-22T16:06:45Z urn:sha1:f4bd9e3c85341c0805821728d42d74c19cb16bde wip: updated requirements 2024-08-21T13:18:23Z lian-manonog lian.manonog@gmail.com 2024-08-21T13:18:23Z urn:sha1:562fac411ce0bedf3dbf067390cacef89ef47981 function to write files from s3 into a list of dataframes. Current test is failing due to AioClientCreator object has no attribute "_inject_s3_input_parameters" 2024-08-21T11:50:32Z Ang Bel anzelikabelotelova@Anzelikas-MacBook-Air.local 2024-08-21T11:50:32Z urn:sha1:b4fafcd9731f11f6f2efde843242b9c5cb84e85f procefss_and_upload_tables test in progress 2024-08-15T15:45:47Z Ang Bel anzelikabelotelova@Anzelikas-MacBook-Air.local 2024-08-15T15:45:47Z urn:sha1:c9bf342c8f6038a3f5397bfc8c53d251f27e7eec