aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'development' into test/transform-helper-functionsbulve-ad2024-08-274-3/+292
|\
| * Merge pull request #98 from ajschofield/test/transform-helper-functionsbulve-ad2024-08-272-57/+95
| |\ | | | | | | pr: refactored facts transformation functions and one test for it
| | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-272-145/+366
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in a05a371 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/98
| * | Merge pull request #95 from ajschofield/feature/load-lambdaAlex2024-08-273-3/+291
| |\ \ | | | | | | | | Feature/load lambda
| | * \ Merge branch 'development' into feature/load-lambdaEllie2024-08-275-13/+733
| | |\ \ | | |/ / | |/| |
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-39/+80
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 0ff2956 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/95
| | * | add updated testEllie2024-08-231-4/+4
| | | |
| | * | add updated testsEllie2024-08-231-1/+15
| | | |
| | * | add amendendments for upload_dfs_to_dbEllie2024-08-231-13/+34
| | | |
| | * | add retrieve secrets functionEllie2024-08-231-1/+20
| | | |
| | * | add working completed tests for get transform bucketEllie2024-08-231-5/+13
| | | |
| | * | adds passing transform bucket testsEllie2024-08-231-11/+19
| | | |
| | * | add get transform bucket testEllie2024-08-232-5/+45
| | | |
| | * | add amendments to load lambdaEllie2024-08-231-29/+37
| | | |
| | * | add SQLalchemy to requirementsEllie2024-08-231-1/+2
| | | |
| | * | add testsEllie2024-08-232-5/+59
| | | |
| | * | add get transform bucket functionEllie2024-08-231-1/+15
| | | |
| | * | add improved convert parquet files to df functionEllie2024-08-231-14/+19
| | | |
| | * | add pyarrow to requirementsEllie2024-08-231-1/+2
| | | |
| | * | wip: add test file for load lambdaEllie2024-08-221-0/+9
| | | |
| | * | add convert parquet to df functionEllie2024-08-221-2/+48
| | | |
* | | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-272-148/+368
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 22df92b according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/99
* | | | test: refactored fact functions with test passingAng Bel2024-08-272-14/+19
| |_|/ |/| |
* | | test: fact transformation function for payment test passes, other fact ↵Ang Bel2024-08-273-412/+229
|/ / | | | | | | functions are equivalent, no tests written
* | Merge pull request #97 from ajschofield/test/test_transform_lambdalian-manonog2024-08-274-150/+270
|\ \ | | | | | | PR: mergeing test_transform_lambda to dev
| * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-273-59/+65
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in c68f63f according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/97
| * | wip: refactored fact payment functionlian-manonog2024-08-272-8/+9
| | |
| * | wip: added a bracket in dataframeslian-manonog2024-08-272-3/+4
| | |
| * | Merge pull request #96 from ajschofield/test/dataframesbulve-ad2024-08-232-169/+233
| |\ \ | | | | | | | | pr: combining tests for transform lambda
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-38/+41
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 8f75a47 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/96
| | * | Merge branch 'test/test_transform_lambda' into test/dataframesbulve-ad2024-08-2311-283/+340
| | |\ \ | | |/ / | |/| |
| * | | wip: writing more tests for the helper functionslian-manonog2024-08-231-2/+12
| | | |
| * | | wip: pushing againlian-manonog2024-08-233-9/+47
|/ / /
* | | Merge pull request #94 from ajschofield/feature/transform-fact-sales-orderlian-manonog2024-08-235-10/+611
|\ \ \ | |_|/ |/| | PR: rebased the fact-sales branch with the datafrrames branch - now merging into development
| * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-231-4/+3
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 88f1ef7 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/94
| * | Removed redundant empty lines of codelian-manonog2024-08-231-4/+0
| | |
| * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-232-10/+15
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 3ff2182 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
| * | trying to resolce git index issue conflicts - commiting was the only solutionlian-manonog2024-08-232-9/+8
| | |
| * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-234-180/+319
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 8e20c5c according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/93
| * | Deleted the fact_table schema py fileslian-manonog2024-08-234-233/+157
| | | | | | | | | | | | | | | | | | Completed Lambda_handler for transform_lambda - and other helper functions. Testing is still to be done. Need to implement lambda layer to share helper functions across all lambdas
* | | Merge pull request #90 from ajschofield/alex/fix-extract-lambda-testAlex2024-08-224-34/+90
|\ \ \ | | | | | | | | pr: fix extract lambda tests
| * | | fix: improve error handling for list_existing_s3_files and testsAlex Schofield2024-08-222-8/+18
| | | |
| * | | fix: handle no buckets properlyAlex Schofield2024-08-222-5/+8
| | | |
| * | | chore: skip transform_lambda tests are they are brokenAlex Schofield2024-08-221-0/+2
| | | |
| * | | chore: skip secrets_manager tests are they are brokenAlex Schofield2024-08-221-0/+4
| | | |
| * | | fix: resolve import errorAlex Schofield2024-08-221-1/+1
| | | |
| * | | fix: mock aws services before importing src functionsAlex Schofield2024-08-221-9/+11
| | | |
| * | | fix: change default parameters for bucket_name and clientAlex Schofield2024-08-221-2/+9
| | | |
| * | | fix: inject mock_config into interface error testAlex Schofield2024-08-221-2/+15
| | | |
| * | | fix: convert credentials to json dictAlex Schofield2024-08-221-7/+9
| | | |
git.ajschof.me — hosted by ajschofield — powered by cgit