aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* ci: create deploy.ymlAlex2024-08-291-0/+42
|
* Merge pull request #108 from ajschofield/developmentAlex2024-08-2918-89/+1671
|\ | | | | pr: final push, data warehouse is currently empty to test that it uploads through terraform
| * Merge pull request #107 from ajschofield/feat/dataframesbulve-ad2024-08-296-109/+233
| |\ | | | | | | pr: working load lambda when no data is present in the warehouse
| | * style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-293-95/+105
| | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 48e7dae according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/107
| | * fix: added comma. Code complete and uploads all tables in one go if no data ↵Ang Bel2024-08-291-10/+9
| | | | | | | | | | | | exists per each table
| | * fix: adds missing dataframes and resolves tables upload to end data ↵Ang Bel2024-08-284-18/+35
| | | | | | | | | | | | warehouse in case the table is empty
| | * wip commitT-Aji2024-08-284-71/+115
| | |
| | * debugging load_lambdaT-Aji2024-08-281-2/+3
| | |
| | * refactored functs to include columns instead of drop columnsT-Aji2024-08-284-58/+111
| | |
| * | Merge pull request #106 from ajschofield/test/transform-lambdaAlex2024-08-283-18/+71
| |\ \ | | | | | | | | PR: tests for transform into dev
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-281-4/+3
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 6c85677 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/106
| | * | chore: get out of merge hellAlex2024-08-281-19/+2
| | | |
| | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-281-6/+9
| | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 4651e2f according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/106
| | * | Merge branch 'test/transform-lambda' of ↵lian-manonog2024-08-282-36/+55
| | |\ \ | | | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into test/transform-lambda
| | | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-282-58/+55
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in ad357ff according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/105
| | * | | Merge branch 'development' of ↵lian-manonog2024-08-287-111/+593
| | |\ \ \ | | |/ / / | |/| / / | | |/ / https://github.com/ajschofield/de-project-bentley into test/transform-lambda
| * | | Merge pull request #104 from ajschofield/temp_branch_for_prHastarTara2024-08-281-2/+4
| |\ \ \ | | |_|/ | |/| | Temp branch for pr
| | * | work on lambda handler dirctory config 2HastarTara2024-08-281-8/+3
| | | |
| | * | work on lambda handler dirctory configHastarTara2024-08-281-0/+7
| | | |
| * | | Merge pull request #103 from ajschofield/temp_branch_for_prHastarTara2024-08-282-0/+0
| |\| | | | | | | | | | Temp branch for pr
| | * | Merge branch 'development' of ↵HastarTara2024-08-284-45/+206
| | |\ \ | | |/ / | |/| | | | | | https://github.com/ajschofield/de-project-bentley into development
| * | | Merge pull request #102 from ajschofield/feature/load-lambda-testsEllie2024-08-284-45/+206
| |\ \ \ | | | | | | | | | | pr: feature/load lambda tests
| | * | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-282-61/+59
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in d0b0fa9 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/102
| | * | | Merge branch 'development' into feature/load-lambda-testsEllie2024-08-282-72/+33
| | |\ \ \ | | |/ / / | |/| | |
| | * | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-283-104/+123
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 08c971f according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/102
| | * | | add json.loads to retrieve secretsEllie2024-08-281-2/+2
| | | | |
| | * | | add json.loadsEllie2024-08-281-4/+5
| | | | |
| | * | | amend to inner joinEllie2024-08-281-3/+3
| | | | |
| | * | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-282-0/+63
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in a05a371 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/98
| | * | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-283-148/+375
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 1a145a3 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/101
| | * | | test: transform refactoring - it now loads parquet files into s3 bucketAng Bel2024-08-283-26/+22
| | | | |
| | * | | test: refactored fact functions with test passingAng Bel2024-08-282-14/+19
| | | | |
| | * | | test: fact transformation function for payment test passes, other fact ↵Ang Bel2024-08-283-412/+229
| | | | | | | | | | | | | | | | | | | | functions are equivalent, no tests written
| | * | | add lambda handler updated testsEllie2024-08-271-0/+1
| | | | |
| | * | | add passing tests for lambda handlerEllie2024-08-271-7/+9
| | | | |
| | * | | add logger error to lambda handlerEllie2024-08-271-5/+7
| | | | |
| | * | | wip: update TestLambdaHandler & lambda_handler functionAlex Schofield2024-08-272-11/+20
| | | | |
| | * | | docs: add comments for upload testsAlex Schofield2024-08-271-0/+3
| | | | |
| | * | | test: add lambda_handler testsAlex Schofield2024-08-271-6/+21
| | | | |
| | * | | wip: add test for parquet file conversionAlex Schofield2024-08-271-8/+51
| | | | |
| | * | | refactor: add parameter for sm_secretAlex Schofield2024-08-271-3/+6
| | | | |
| | * | | add passing retrieve secrets testsEllie2024-08-271-5/+18
| | | | |
| | * | | add json.loads to retrieve secrests functionEllie2024-08-271-6/+9
| | | | |
| | * | | add first retrieve secrets testEllie2024-08-271-11/+33
| | | | |
| | * | | add test progressEllie2024-08-271-3/+4
| | | | |
| | * | | remove import as not requiredEllie2024-08-271-3/+5
| | | | |
| | | * | moved extract_l & dataframes into own directory in srcHastarTara2024-08-282-0/+0
| | |/ / | |/| |
| * | | Merge pull request #101 from ajschofield/test/transform-helper-functionsbulve-ad2024-08-273-32/+34
| |\ \ \ | | | | | | | | | | test: transform refactoring - it now loads parquet files into s3 bucket
| | * \ \ Merge branch 'development' into test/transform-helper-functionsbulve-ad2024-08-273-3/+291
| | |\ \ \ | | |/ / / | |/| | |
| * | | | Merge pull request #100 from ajschofield/test/transform-helper-functionsbulve-ad2024-08-272-24/+29
| |\ \ \ \ | | | | | | | | | | | | pr: test/transform helper functions
git.ajschof.me — hosted by ajschofield — powered by cgit