index
:
de-project-bentley
development
main
Northcoders project - ETL pipeline with AWS
Alex Schofield
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
Commit message (
Expand
)
Author
Age
Files
Lines
...
|
*
|
refactor df creation into func
T-Aji
2024-08-22
1
-70
/
+34
|
*
|
wip: creating dim dataframes
T-Aji
2024-08-22
3
-9
/
+58
|
|
\
\
|
|
*
|
wip: fact_purchase_order schema
lian-manonog
2024-08-21
3
-3
/
+37
|
|
*
|
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-21
1
-18
/
+68
|
*
|
|
began dim_date df
T-Aji
2024-08-21
1
-18
/
+17
|
|
/
/
|
*
|
Merge branch 'feature/transform-fact-sales-order' of https://github.com/ajsch...
T-Aji
2024-08-21
0
-0
/
+0
|
|
\
\
|
|
*
|
add dim tables: design, staff, currency, location (wip)
Ellie
2024-08-21
1
-0
/
+54
|
|
*
|
ci: rm dev-test.yml
Alex
2024-08-20
1
-49
/
+0
|
|
*
|
ci: update dev-test.yml
Alex
2024-08-20
1
-0
/
+1
|
|
*
|
ci: add dev-test.yml
Alex
2024-08-20
1
-0
/
+48
|
|
*
|
Merge pull request #80 from ajschofield/development
Alex
2024-08-20
1
-0
/
+1
|
|
|
\
\
|
*
|
|
|
5 dim tables created
T-Aji
2024-08-21
1
-15
/
+33
|
*
|
|
|
add dim tables: design, staff, currency, location (wip)
Ellie
2024-08-21
1
-0
/
+54
|
*
|
|
|
ci: rm dev-test.yml
Alex
2024-08-21
1
-49
/
+0
|
*
|
|
|
ci: update dev-test.yml
Alex
2024-08-21
1
-0
/
+1
|
*
|
|
|
ci: add dev-test.yml
Alex
2024-08-21
1
-0
/
+48
|
|
|
|
*
style: format code with Autopep8, Black and Ruff Formatter
deepsource-autofix[bot]
2024-08-23
2
-39
/
+80
|
|
|
|
*
add updated test
Ellie
2024-08-23
1
-4
/
+4
|
|
|
|
*
add updated tests
Ellie
2024-08-23
1
-1
/
+15
|
|
|
|
*
add amendendments for upload_dfs_to_db
Ellie
2024-08-23
1
-13
/
+34
|
|
|
|
*
add retrieve secrets function
Ellie
2024-08-23
1
-1
/
+20
|
|
|
|
*
add working completed tests for get transform bucket
Ellie
2024-08-23
1
-5
/
+13
|
|
|
|
*
adds passing transform bucket tests
Ellie
2024-08-23
1
-11
/
+19
|
|
|
|
*
add get transform bucket test
Ellie
2024-08-23
2
-5
/
+45
|
|
|
|
*
add amendments to load lambda
Ellie
2024-08-23
1
-29
/
+37
|
|
|
|
*
add SQLalchemy to requirements
Ellie
2024-08-23
1
-1
/
+2
|
|
|
|
*
add tests
Ellie
2024-08-23
2
-5
/
+59
|
|
|
|
*
add get transform bucket function
Ellie
2024-08-23
1
-1
/
+15
|
|
|
|
*
add improved convert parquet files to df function
Ellie
2024-08-23
1
-14
/
+19
|
|
|
|
*
add pyarrow to requirements
Ellie
2024-08-23
1
-1
/
+2
|
|
|
|
*
wip: add test file for load lambda
Ellie
2024-08-22
1
-0
/
+9
|
|
|
|
*
add convert parquet to df function
Ellie
2024-08-22
1
-2
/
+48
|
|
_
|
_
|
/
|
/
|
|
|
*
|
|
|
Merge pull request #90 from ajschofield/alex/fix-extract-lambda-test
Alex
2024-08-22
4
-34
/
+90
|
\
\
\
\
|
*
|
|
|
fix: improve error handling for list_existing_s3_files and tests
Alex Schofield
2024-08-22
2
-8
/
+18
|
*
|
|
|
fix: handle no buckets properly
Alex Schofield
2024-08-22
2
-5
/
+8
|
*
|
|
|
chore: skip transform_lambda tests are they are broken
Alex Schofield
2024-08-22
1
-0
/
+2
|
*
|
|
|
chore: skip secrets_manager tests are they are broken
Alex Schofield
2024-08-22
1
-0
/
+4
|
*
|
|
|
fix: resolve import error
Alex Schofield
2024-08-22
1
-1
/
+1
|
*
|
|
|
fix: mock aws services before importing src functions
Alex Schofield
2024-08-22
1
-9
/
+11
|
*
|
|
|
fix: change default parameters for bucket_name and client
Alex Schofield
2024-08-22
1
-2
/
+9
|
*
|
|
|
fix: inject mock_config into interface error test
Alex Schofield
2024-08-22
1
-2
/
+15
|
*
|
|
|
fix: convert credentials to json dict
Alex Schofield
2024-08-22
1
-7
/
+9
|
*
|
|
|
fix: add missing mock_conn fixture
Alex Schofield
2024-08-22
1
-0
/
+7
|
*
|
|
|
fix: remove bucket deletion for index error test
Alex Schofield
2024-08-22
1
-3
/
+2
|
*
|
|
|
fix: create two mocked buckets and check if extract_bucket is returned
Alex Schofield
2024-08-22
1
-1
/
+8
|
*
|
|
|
feat: autouse credentials fixture
Alex Schofield
2024-08-22
1
-1
/
+1
|
*
|
|
|
fix: update additional fixtures to use scope function
Alex Schofield
2024-08-22
1
-2
/
+2
|
*
|
|
|
fix: change fixture scope to function instead of class
Alex Schofield
2024-08-22
1
-2
/
+2
*
|
|
|
|
Merge pull request #92 from ajschofield/alex/ci-artifact-upload
Alex
2024-08-22
1
-0
/
+7
|
\
\
\
\
\
|
*
|
|
|
|
ci: upload coverage report as artifact
Alex
2024-08-22
1
-0
/
+7
|
/
/
/
/
/
[prev]
[next]
git.ajschof.me
— hosted by
ajschofield
— powered by
cgit