aboutsummaryrefslogtreecommitdiffstats
path: root/src/transform_lambda.py
Commit message (Collapse)AuthorAgeFilesLines
* style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-231-3/+6
| | | | | | This commit fixes the style issues introduced in 3ff2182 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
* trying to resolce git index issue conflicts - commiting was the only solutionlian-manonog2024-08-231-9/+4
|
* style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-231-44/+56
| | | | | | This commit fixes the style issues introduced in 8e20c5c according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
* Deleted the fact_table schema py fileslian-manonog2024-08-231-41/+157
| | | | | | Completed Lambda_handler for transform_lambda - and other helper functions. Testing is still to be done. Need to implement lambda layer to share helper functions across all lambdas
* wip: wrote pseudocode for lambda handler in writing df to parquet file ↵lian-manonog2024-08-221-4/+52
| | | | format and uploading the parquet files
* wip: fact_purchase_order schemalian-manonog2024-08-211-2/+2
|
* Merge branch 'development' into feature/transform_lambdabulve-ad2024-08-211-1/+0
|\
| * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-191-1/+1
| | | | | | | | | | | | This commit fixes the style issues introduced in e27c6b4 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/55
* | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-211-16/+20
| | | | | | | | | | | | This commit fixes the style issues introduced in b882bb0 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/84
* | complete version of read from s3 subfolderAng Bel2024-08-211-32/+1
| |
* | (tests) Read from s3 to df passesAng Bel2024-08-211-22/+4
| |
* | function to write files from s3 into a list of dataframes. Current test is ↵Ang Bel2024-08-211-4/+30
| | | | | | | | failing due to AioClientCreator object has no attribute "_inject_s3_input_parameters"
* | wip: just more pseudocodelian-manonog2024-08-201-12/+26
| |
* | wip: writing pseudocode logic for the lambda_handlerlian-manonog2024-08-201-14/+22
| |
* | wip: added read_csb functionailty to lambda_handlerlian-manonog2024-08-191-8/+32
| |
* | wip: setting up test files for transform_lambdalian-manonog2024-08-191-0/+9
|/
* wip: terraform debugginglian-manonog2024-08-141-0/+2
|
* s3 buckets in tf and initial blank lambda py files set-up in src folder for ↵Ang Bel2024-08-131-0/+0
the next task of lambda tf set up
git.ajschof.me — hosted by ajschofield — powered by cgit