Upload system services on ipfs node

[krhubert]

close #840

[antho1404]

I think there is some issue of compatibility between osx and linux

➜  core git:(feature/upload-systemservices) ✗ ./scripts/build-core.sh
./scripts/build-core.sh: line 12: ${name^}: bad substitution

[NicolasMahe]

I think there is some issue of compatibility between osx and linux

➜  core git:(feature/upload-systemservices) ✗ ./scripts/build-core.sh
./scripts/build-core.sh: line 12: ${name^}: bad substitution

It should be run inside a Docker container...
Try to run docker build .

[antho1404]

It doesn't work in docker too

/bin/sh: 1: ./scripts/build-core.sh: not found

[antho1404]

finally built by removing the script directory in the .dockerignore but still some error when running it.

time="2019-04-23T05:10:21Z" level=info msg="Deploying service \"ethwallet\" from \"\""
time="2019-04-23T05:10:21Z" level=fatal msg="Get : unsupported protocol scheme \"\""
time="2019-04-23T05:10:26Z" level=info msg="Deploying service \"ethwallet\" from \"\""
time="2019-04-23T05:10:26Z" level=fatal msg="Get : unsupported protocol scheme \"\""

@krhubert please test correctly and/or give a description on the pull request on how to test it.

[NicolasMahe]

I cannot run it also.
I runned (like the CI):

docker build -t mesg/core:dev --build-arg version="dev build test" .

[krhubert]

@antho1404 @NicolasMahe fixed

➜  core git:(feature/upload-systemservices) ✗ ./bin/cli logs      
time="2019-04-23T08:33:34Z" level=info msg="Deploying service \"ethwallet\" from \"http://ipfs.app.mesg.com:8080/ipfs/Qmcvqsd5kSTeB2bbzh4N4JqfUn1kJ4YyCQEzuCVf3fLPbj\""
time="2019-04-23T08:35:29Z" level=info msg="Service \"ethwallet\" deployed with hash \"9bAzHe2RyoYwAZLA2JUzDsgNnz3NtTYLADKCWf1E8VDf\""
time="2019-04-23T08:35:30Z" level=info msg="Deploying service \"marketplace\" from \"http://ipfs.app.mesg.com:8080/ipfs/QmbegmPwNnPGuYaMtoiFhGaTKYF2B6Jb1sk3UYVeywJuLr\""

To test locally you can

$ docker build -t mesg/core:local .
$ ./bin/cli start
$ ./bin/cli logs

[antho1404]

I cannot test it, I keep having the same error

go: gopkg.in/src-d/go-git-fixtures.v3@v3.3.0: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /go/pkg/mod/cache/vcs/67698a57fcf1e2e2f3930542ab0263846a1ad71c488399c086e4929ccb6a539b: exit status 128:
        error: RPC failed; curl 56 GnuTLS recv error (-9): A TLS packet with unexpected length was received.
        fatal: The remote end hung up unexpectedly
        fatal: early EOF
        fatal: index-pack failed

any recommendation?

[ilgooz]

I cannot test it, I keep having the same error

go: gopkg.in/src-d/go-git-fixtures.v3@v3.3.0: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /go/pkg/mod/cache/vcs/67698a57fcf1e2e2f3930542ab0263846a1ad71c488399c086e4929ccb6a539b: exit status 128:
        error: RPC failed; curl 56 GnuTLS recv error (-9): A TLS packet with unexpected length was received.
        fatal: The remote end hung up unexpectedly
        fatal: early EOF
        fatal: index-pack failed

any recommendation?

we need to setup a module proxy for our automated builds. it'll fasten things a lot because there'll be no git clones, every download will use pre created zips for each package and we'll avoid missing packages or connection problems to third party servers like this. i can setup a proxy just in minutes maybe on http://goproxy.dev.mesg.com.

@NicolasMahe can you create a DNS record for *.dev.mesg.com to point DO, it can be useful.

[NicolasMahe]

@NicolasMahe can you create a DNS record for *.dev.mesg.com to point DO, it can be useful.

Done

[NicolasMahe]

I cannot test it, I keep having the same error

go: gopkg.in/src-d/go-git-fixtures.v3@v3.3.0: git fetch -f origin refs/heads/*:refs/heads/* refs/tags/*:refs/tags/* in /go/pkg/mod/cache/vcs/67698a57fcf1e2e2f3930542ab0263846a1ad71c488399c086e4929ccb6a539b: exit status 128:
        error: RPC failed; curl 56 GnuTLS recv error (-9): A TLS packet with unexpected length was received.
        fatal: The remote end hung up unexpectedly
        fatal: early EOF
        fatal: index-pack failed

any recommendation?

Setup Athens: https://docs.gomods.io/install/shared-team-instance/
And inject the env variable in Dockerfile: ENV GOPROXY=http://host.docker.internal:3000

[ilgooz]

i enabled the proxy at http://goproxy.dev.mesg.com and cached gopkg.in/src-d/go-git-fixtures.v3@v3.3.0 for you. please use this one as a proxy, you shouldn't face with any problems.

if you don't even want to go to outside network, you can spin up an http static file server at your $GOPATH/pkg/mod/cache/vcs and it'll be your local goproxy.

[antho1404]

the proxy did the job thanks.