aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
...
| | | * function to write files from s3 into a list of dataframes. Current test is ↵Ang Bel2024-08-213-6/+64
| | | | | | | | | | | | | | | | failing due to AioClientCreator object has no attribute "_inject_s3_input_parameters"
| | | * wip: just more pseudocodelian-manonog2024-08-201-12/+26
| | | |
| | | * wip: writing pseudocode logic for the lambda_handlerlian-manonog2024-08-201-14/+22
| | | |
| | | * wip: added read_csb functionailty to lambda_handlerlian-manonog2024-08-191-8/+32
| | | |
| | | * wip: setting up test files for transform_lambdalian-manonog2024-08-192-0/+10
| |_|/ |/| |
* | | Merge pull request #51 from ajschofield/lambda-layersAlex2024-08-163-82/+80
|\ \ \ | | | | | | | | pr: add lambda layers functionality
| * | | chore(tf): remove dummy username/passwordAlex Schofield2024-08-161-12/+2
| | | | | | | | | | | | | | | | sorry hackers!
| * | | infra(tf): re-add code that creates layer zipAlex Schofield2024-08-161-12/+12
| | | |
| * | | infra(tf): add version constraints for null and archiveAlex Schofield2024-08-161-0/+8
| | | |
| * | | infra[tf] update lambda extract doesnt work yetHastarTara2024-08-161-4/+4
| | | |
| * | | Merge branch 'development' of ↵HastarTara2024-08-165-118/+166
| |\ \ \ | | | | | | | | | | | | | | | https://github.com/ajschofield/de-project-bentley into lambda-layers
| * | | | comment out rds.tf to increases tf speedEllie2024-08-161-69/+69
| | | | |
* | | | | Merge pull request #47 from ajschofield/extract_lambda_refactoringAlex2024-08-162-74/+102
|\ \ \ \ \ | | | | | | | | | | | | Update to extract lambda to only range changes from totesys
| * | | | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-161-1/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 890ca04 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/47
| * | | | | dummy comment to test checksAng Bel2024-08-161-1/+1
| | | | | |
| * | | | | Merge branch 'development' into extract_lambda_refactoringAlex2024-08-166-155/+159
| |\ \ \ \ \ | |/ / / / / |/| | | | |
* | | | | | Merge pull request #50 from ajschofield/ci/update-deployAlex2024-08-161-1/+1
|\ \ \ \ \ \ | | | | | | | | | | | | | | fix(ci): amend pull to push
| * | | | | | fix(ci): amend pull to pushAlex Schofield2024-08-161-1/+1
| | | | | | |
* | | | | | | Merge pull request #49 from ajschofield/ci/update-deployAlex2024-08-161-1/+1
|\| | | | | | | | | | | | | | | | | | | | fix(ci): amend pull_request syntax
| * | | | | | fix(ci): amend pull_request syntaxAlex Schofield2024-08-161-1/+1
|/ / / / / /
* | | | | | Merge pull request #48 from ajschofield/ci-cd-branchAlex2024-08-163-55/+90
|\ \ \ \ \ \ | |_|_|/ / / |/| | | | | pr: makefile & new github action workflow
| * | | | | Merge branch 'development' into ci-cd-branchAlex2024-08-166-118/+201
| |\ \ \ \ \ | |/ / / / / |/| | | | |
* | | | | | Merge pull request #46 from ajschofield/alex/docs-updateAlex2024-08-163-101/+70
|\ \ \ \ \ \ | | | | | | | | | | | | | | docs: init documentation
| * \ \ \ \ \ Merge branch 'main' into alex/docs-updateAlex Schofield2024-08-161-0/+27
| |\ \ \ \ \ \ | | | |_|_|_|/ | | |/| | | |
| | * | | | | fix(ci): fix .deepsource.toml configAlex2024-08-161-3/+0
| | | | | | |
| | * | | | | ci: update .deepsource.tomlAlex2024-08-161-0/+5
| | | | | | |
| | * | | | | ci: create .deepsource.tomlAlex2024-08-161-0/+25
| | | | | | | | | | | | | | | | | | | | | for automated commit checking
| * | | | | | docs: add empty sectionsAlex Schofield2024-08-161-1/+7
| | | | | | |
| * | | | | | docs: add draft key features sectionAlex Schofield2024-08-161-1/+14
| | | | | | |
| * | | | | | docs(main_obj): clarify data being loaded into data warehouseAlex Schofield2024-08-161-1/+1
| | | | | | |
| * | | | | | docs: add draft main objective sectionAlex Schofield2024-08-161-1/+11
| | | | | | |
| * | | | | | docs: add draft summary sectionAlex Schofield2024-08-161-1/+14
| | | | | | |
| * | | | | | docs: rm DEVNOTES.mdAlex Schofield2024-08-161-100/+0
| | |_|_|_|/ | |/| | | | | | | | | | | | | | | | basically redundant now
| | | * | | ci: deploy only on push/pr to mainAlex Schofield2024-08-161-4/+7
| | | | | |
| | | * | | chore(ci): remove redundant on-commit.ymlAlex Schofield2024-08-161-50/+0
| | | | | |
| | | * | | add makefile in root: not in use currentlylian-manonog2024-08-161-0/+80
| | | | | |
| | | * | | wip: change env line 14 to productionlian-manonog2024-08-161-2/+4
| | | | | |
| | | * | | wip: pushing the ci-cd-branch to test terraform infralian-manonog2024-08-161-1/+1
| | |/ / / | |/| | |
| | | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-161-26/+40
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in 4428b8d according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/47
| | | * | refactoring to be more in line with pythonic code practices and prevent sql ↵Ang Bel2024-08-161-6/+11
| | | | | | | | | | | | | | | | | | | | injection
| | | * | refactor following github actions major risk messageAng Bel2024-08-161-34/+31
| | | | |
| | | * | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-161-59/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in dd68d94 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/47
| | | * | refactoring for extract lambda to filter by last updated and if not empty ↵Ang Bel2024-08-162-15/+13
| |_|/ / |/| | | | | | | | | | | write it s3
* | | | Merge pull request #45 from ajschofield/lambda-layersbulve-ad2024-08-161-0/+35
|\ \ \ \ | | |_|/ | |/| | add lambda layer
| * | | add lambda layerEllie2024-08-161-0/+35
| |/ /
* | | Merge pull request #44 from ajschofield/feature/extract_lambda_testingbulve-ad2024-08-162-17/+96
|\ \ \ | |/ / |/| | Secrets manager integration and addition of bucket name helper function
| * | extract bucket name retrieval helper function and replace the bucket name ↵Ang Bel2024-08-161-4/+7
| | | | | | | | | | | | placeholders
| * | Secrets manager integration into the extract lambda reviewed.Ang Bel2024-08-162-13/+89
| | |
* | | Merge branch 'main' into developmentAlex Schofield2024-08-150-0/+0
|\ \ \ | | |/ | |/|
| * | chore: rm on-commit.ymlAlex2024-08-151-40/+0
| | | | | | | | | for now, we will test within feature/ci-tests branch
git.ajschof.me — hosted by ajschofield — powered by cgit