Feature/golang docker api #13

algo7 · 2023-03-17T22:51:42Z

No description provided.

…and sourceDir existence.

… dockerfile instead of not dropping the privilege and let nodejs create the file

…iner provisioner

…args

…d identifier

algo7 added 30 commits March 16, 2023 10:32

main.go template

7d08348

basic container logic

7bcd899

add env var support for hotel scraper

be93601

make raw data from env var an array of objs

e82a8dc

env vars adaptation

6a302cb

Long term bug discovered. Fix => use accessSync to check for dataDir …

39a4d08

…and sourceDir existence.

change access to accessSync in utils.js. create the dir beforehand in…

eac6045

… dockerfile instead of not dropping the privilege and let nodejs create the file

change source and datadir ownership, add CONCURRENCY env var to conta…

dcb4593

…iner provisioner

add comment to container provisioner

9f7c139

move container logic to provisioner

7d157a1

implement write to file function

4de6b8e

remove unused dependency

f808272

finish the write to file function

755c878

add err handling when writing to the file

fd190e5

err handling when creating file

174a47d

refactor the write to file function

946d298

introduce err handler + refactoring

1be29c7

add autoremove option to containerCreate func

c6e9cd6

set autoremove to false otherwise file copy fails

2f2ede8

var rename

af9d6da

change container remove options

384b681

cloudflare r2 logic

b67dd91

add read from file function, refactor r2uploadobject func to take in …

f5f4a11

…args

modify data type of fileName for R2UploadObject func

2810d63

add accountId as an input to resolveEndpoint func

78b2ba7

refactor cloudflare r2 logic

46f790b

change read file logic to use func args

a7346ec

add Creds struct

55166b0

implement parse creds from json func

46cbee0

implement the file upload logic in mainl.go

d258b5f

algo7 added 27 commits March 17, 2023 16:04

add dockerfile for container provisioner

f2845a7

dockerfile comments

2afb286

disable image pulling

4923b08

add dockerignore

55bd5e8

add label to image

9d5a105

refactoring, new creds reading logic via bind mount

f8ab41e

fix fiber acting weird in alpine-based container

ea13f44

docker-compose bind mount docker socket

0f4cc40

change sunbmission view logic and refactor container logic

29d24a0

refactor how docker related func use context and client

81b3fc7

comments

c1335a4

fix image name typo. another long standing bug

4643cc6

CountRunningContainer refactoring

9a46abc

comments

a9de33b

add is container env var to docker-compose.yml

2fe51e0

change container limit to 10, and refactor ctx logic in cloudfalre.go

9187baa

improve efficiency by removing nested loop

229c39c

use the uuid as file suffix for readability

7863526

reduce the length of the UUID to 8 char

119859f

increase uuid length to 11 and limit the number of char for the uploa…

9709deb

…d identifier

add support email to the main view

eebeb8f

add date to the display table

d25b30f

add parse time function

0a3bac8

add time sort function

ee1cf6a

remove unused logs, aesthetic tweak to the main view

860775c

formatting

0cdc5ee

use production image

10f2b8f

algo7 self-assigned this Mar 17, 2023

algo7 merged commit 3d28b08 into main Mar 17, 2023

algo7 deleted the feature/golang_docker_api branch March 17, 2023 22:52

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feature/golang docker api #13

Feature/golang docker api #13

algo7 commented Mar 17, 2023

Feature/golang docker api #13

Feature/golang docker api #13

Conversation

algo7 commented Mar 17, 2023