aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'feature/transform-fact-sales-order' of ↵T-Aji2024-08-210-0/+0
|\ | | | | | | https://github.com/ajschofield/de-project-bentley into feature/transform-fact-sales-order
| * add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| |
| * ci: rm dev-test.ymlAlex2024-08-201-49/+0
| | | | | | It's in the wrong branch...
| * ci: update dev-test.ymlAlex2024-08-201-0/+1
| |
| * ci: add dev-test.ymlAlex2024-08-201-0/+48
| |
| * Merge pull request #80 from ajschofield/developmentAlex2024-08-201-0/+1
| |\ | | | | | | pr: github actions trigger deployment only if ref is main
* | | 5 dim tables createdT-Aji2024-08-211-15/+33
| | |
* | | add dim tables: design, staff, currency, location (wip)Ellie2024-08-211-0/+54
| | |
* | | ci: rm dev-test.ymlAlex2024-08-211-49/+0
| | | | | | | | | It's in the wrong branch...
* | | ci: update dev-test.ymlAlex2024-08-211-0/+1
| | |
* | | ci: add dev-test.ymlAlex2024-08-211-0/+48
| | |
* | | Merge pull request #84 from ajschofield/feature/transform_lambdabulve-ad2024-08-214-4/+120
|\ \ \ | | | | | | | | Feature/transform lambda read from s3 into df
| * \ \ Merge branch 'development' into feature/transform_lambdabulve-ad2024-08-2124-487/+676
| |\ \ \ | |/ / / |/| | |
* | | | Merge pull request #83 from ajschofield/ci/add-dev-tests-ymlAlex2024-08-201-0/+48
|\ \ \ \ | | | | | | | | | | pr: create dev-tests.yml
| * | | | ci: remove environment for dev-tests.ymlAlex2024-08-201-1/+0
| | | | |
| * | | | ci: create dev-tests.ymlAlex2024-08-201-0/+49
|/ / / /
* | | | Merge pull request #82 from ajschofield/test/test-branchAlex2024-08-201-2/+2
|\ \ \ \ | | | | | | | | | | test: test trigger for ci/cd
| * | | | test: test trigger for ci/cdAlex Schofield2024-08-201-2/+2
|/ / / /
* | | | Merge pull request #81 from ajschofield/alex/remove-dev-ga-workflowAlex2024-08-201-43/+0
|\ \ \ \ | |_|_|/ |/| | | chore: rm workflow file from development
| * | | chore: rm workflow file from developmentAlex2024-08-201-43/+0
|/ / /
* | | Merge pull request #79 from ajschofield/ci/actions-triggerAlex2024-08-201-0/+1
|\ \ \ | | | | | | | | pr: update deploy.yml
| * | | ci: update deploy.ymlAlex2024-08-201-0/+1
|/ / /
* | | Merge pull request #78 from ajschofield/mainAlex2024-08-201-0/+3
|\ \ \ | | |/ | |/| pr: merge lambda timeout hotfix into development
| * | Merge pull request #77 from ajschofield/alex/lambda-timeoutAlex2024-08-201-0/+3
| |\ \ | | | | | | | | hotfix: increase lambda timeout
| | * \ Merge branch 'main' into alex/lambda-timeoutAlex2024-08-200-0/+0
| | |\ \ | | |/ / | |/| |
| * | | Merge pull request #76 from ajschofield/developmentAlex2024-08-2021-101/+1363
| |\ \ \ | |/ / / |/| | | pr: pull development into main
| | * | hotfix: increase lambda timeoutAlex Schofield2024-08-201-0/+3
| |/ / |/| |
* | | Merge pull request #75 from ajschofield/alex/repo-tidy-upAlex2024-08-203-129/+0
|\ \ \ | | | | | | | | pr: tidy-up repository & remove unused files
| * | | chore: tidy-up repository & remove unused filesAlex Schofield2024-08-203-129/+0
|/ / /
* | | Merge pull request #74 from ajschofield/alex/tf-lambda-changesAlex2024-08-202-5/+11
|\ \ \ | | | | | | | | pr: fix extract_lambda execution & policy doc
| * | | infra(tf): add ListBucket and GetObject permissionsAlex Schofield2024-08-201-3/+6
| | | |
| * | | feat: add more logging for debuggingAlex Schofield2024-08-201-2/+5
|/ / /
* | | Merge pull request #73 from ajschofield/alex/tf-s3-permsAlex2024-08-203-45/+63
|\ \ \ | | | | | | | | pr: terraform changes & refactoring/adding to extract_lambda
| * | | infra(tf): force-destroy bucketsAlex Schofield2024-08-201-1/+3
| | | |
| * | | refactor: change rows output to debug logger outputAlex Schofield2024-08-201-2/+1
| | | |
| * | | feat: add additional logging and exclude unnecessary tableAlex Schofield2024-08-201-5/+7
| | | |
| * | | feat: add advanced loggingAlex Schofield2024-08-201-5/+11
| | | |
| * | | feat: conditional logic for if bucket is emptyAlex Schofield2024-08-201-9/+23
| | | |
| * | | feat: revert s3 streaming to previous implementation for uploadingAlex Schofield2024-08-201-31/+25
| | | |
| * | | infra(tf): add missing ListObjectsV2 permissionAlex Schofield2024-08-201-1/+2
| | | |
* | | | Merge pull request #72 from ↵Alex2024-08-201-2/+23
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | ajschofield/feature/test_extract_bucket_helper_function PR: Extract bucket tests completed
| * | | | style: format code with Autopep8, Black and Ruff Formatterdeepsource-autofix[bot]2024-08-201-9/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes the style issues introduced in e788a90 according to the output from Autopep8, Black and Ruff Formatter. Details: https://github.com/ajschofield/de-project-bentley/pull/72
| * | | | Complete: completed testing for extract bucket - all passinglian-manonog2024-08-201-2/+27
|/ / / /
* | | | Merge pull request #71 from ajschofield/alex/py-extract-lambdaAlex2024-08-201-1/+1
|\ \ \ \ | |/ / / |/| | | pr: parse secrets string as json dict to access secrets
| * | | fix(extract_lambda): parse secrets string as json dict to access secret valuesAlex Schofield2024-08-201-1/+1
|/ / /
* | | Merge pull request #70 from ajschofield/alex/tf-secrets-permsAlex2024-08-201-0/+27
|\ \ \ | | | | | | | | pr: add secrets manager permissions in iam.tf
| * | | infra(tf): add resource access for secrets-manager policy docAlex Schofield2024-08-201-1/+1
| | | |
| * | | infra(tf): add secrets manager permissionsAlex Schofield2024-08-201-0/+27
|/ / / | | | | | | | | | I feel like what I've done is bad but we'll find out soon.
* | | Merge pull request #69 from ajschofield/alex/py-improvementsAlex2024-08-202-63/+89
|\ \ \ | | | | | | | | pr: alex's python improvements
| * | | fix(extract_lambda): fix UnboundLocalError when db is called before it is ↵Alex Schofield2024-08-201-0/+1
| | | | | | | | | | | | | | | | assigned a value
git.ajschof.me — hosted by ajschofield — powered by cgit