Sprint Nov 9

[daviddias]

Sprint Nov 9

Sprint Goals

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Pad	Permanent Link
Apps on IPFS	Juan Benet and Friedel Ziegelmayer	https://public.etherpad-mozilla.org/p/nov-9-apps-on-ipfs
infrastructure	Lars Gierth	https://public.etherpad-mozilla.org/p/nov-9-infrastructure
libp2p	David Dias	https://public.etherpad-mozilla.org/p/nov-9-libp2p
js-ipfs	David Dias	https://public.etherpad-mozilla.org/p/nov-9-js-ipfs
go-ipfs	Jeromy Johnson	https://public.etherpad-mozilla.org/p/nov-9-go-ipfs
testing + ci	Jeromy Johnson	https://public.etherpad-mozilla.org/p/nov-9-testing-ci
protocol + specs	Juan Benet	https://public.etherpad-mozilla.org/p/nov-9-protocol-specs
bitswap ml	Juan Benet	https://public.etherpad-mozilla.org/p/nov-9-bitswap-ml
Data Structures	Juan Benet	https://public.etherpad-mozilla.org/p/nov-9-data-structures

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add yourself below, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

[<% name %>](@<% your_GitHub_handle %)

David Dias

• libp2p
  • Continue making modules work in the browser
  • Get webrtc-explorer as one of the transports (blocked by node-webrtc not compiling on the Mac OS X, problem introduced with XCode7 and El Capitan)
  • Sync with @whyrusleeping thoughts on how to level both implementations (on hold till go-libp2p is out of IPFS)
  • Review IPLD
  • make a sync API for js-ipld add sync mode ipld/js-ipld-dag-cbor#8
• npm's registry on IPFS (on hold till 0.3.9 rebase on top of 0.4.0)
  • Release a working version of ipfs-blob-store with all of the new shiny things https://github.com/ipfs/ipfs-blob-store/releases/tag/v0.1.0
  • download the entire npm
  • install modules via IPFS using reginabox+registry-static
• js-ipfs-api
  • fix double recursive flag bug fix double recursive flag ipfs-inactive/js-ipfs-http-client#110
  • fix, make errors parsable again Make errors parsable again ipfs-inactive/js-ipfs-http-client#111
• js-ipfs
  • Continue working on jsipfs module Getting jsipfs out the door js-ipfs#35
• extra
  • IPFS Lisbon
  • Got invited for NodeConf Barcelona + preparing for that
  • Be a NodeKnockout Judge
  • npm org for IPFS

@RichardLitt

IFPS HTTP docs

• Automatically populate a basic template as a one-off seed. Perhaps use Auto generate API.md using mocha ipfs-inactive/js-ipfs-http-client#105.
• Put a Swagger info bloc in ipfs/api.
• Look at httpie
• Document how to use curl for your own use to figure out what is missing in the API docs.
• Add a PR to ipfs.io/docs/api about how the commands there are not all-inclusive.
• Get ipfs add documented.
• Stub out the rest.

READMEs

• Parse IPFS readme's automatically using a CLI tool for ipfs-readme-standard.
• CR on @victorbjelkholm's Add current work in progress of readme.md and api.md ipfs-inactive/js-ipfs-http-client#102
• Help with CI build matrix & selected repo statistics ipfs-inactive/project-repos#1 and CI build monitoring (build matrix) infra#25.

Community

• Add ipfs/ci-status to PD.md
• Sprint management.
• Respond to issue about community infrastructure for meetups.
• Make the documentation around Commit Sign-Offs more friendly
• Edit ipfs/community/blob/master/docs/amending-commits.md
• Go through and move ideas from some sprint changes #43 into ipfs/pm/README.md.
• Template out issue reporting file from Issue Reporting Guide kubo#1946.

@lgierth

• go-ipfs
  • [~] RFCR fix gateway links with url rewrites gateway: add path prefix for directory listings kubo#1971 gateway: set X-Ipfs-Gateway-Prefix header infra#116
  • deploy dev0.4.0 to castor and pluto Run go-ipfs dev0.4.0 on pluto and castor infra#115
• infrastructure
  • fix restarter ipfs/infra@6dfef4b
  • update ansible solarnet: update ansible infra#114
  • remove ipfs logging config, was thought to be broken, but actually removed! repo: remove Log config kubo#1959
  • [~] open up cors on gateways (allow origin *) gateway: open up CORS to everything (allow-origin *) infra#109
  • .h.ipfs.io pointing to cjdns addresses
• refs
  • dmca yyyy/mm/dd structure dmca: create /yyyy/mm/dd structure ipfs-inactive/refs#4
  • writeup for kyledrake https://asciinema.org/a/7wgjaa5co0oo1lft5l1tvws43
• cjdns
  • update to latest v17
  • [~] discover peers from cjdns WIP: discover peers from cjdns kubo#1316
  • invite to fc00 development (aka go-cjdns)
• org stuff
• hope
  • plan for community pinning / pincoop Community Pinning / PinCoop infra#113
  • plan for writable gateway Making ipfs.io gateway writable infra#105

[daviddias]

Endeavour leads, please update your sprint meeting pads with a proposed agenda for tomorrow

@jbenet @whyrusleeping @dignifiedquire @lgierth

[daviddias]

Today, we will be used the newly and agreed sprint times (#50)

https://calendar.google.com/calendar/embed?src=ipfs.io_eal36ugu5e75s207gfjcu0ae84@group.calendar.google.com&ctz=America/New_York

[ghost]

Infrastructure

Agenda

• PinCoop (formerly known as OpenIPFS)

Participants

@jbenet
@kyledrake
@lgierth
@whyrusleeping

Notes

• PinCoop concerns
  • we want to contribute storage
  • security concern: it requires to open up the API so that the web app can pin stuff
  • does it keep track of what gets pinned?
  • another possible solution
    • maintain a refs list of community pinnings which nodes can query and process
• 32C3
  • wiki and call for assemblies were published today
  • no concrete information on ticket sale yet, should be within the next 2 weeks though
  • should we register an assembly? https://events.ccc.de/congress/2015/wiki/Static:Assemblies
• ipfs.io/refs
  • dmca list is finally online at https://ipfs.io/refs/lists/denylists/dmca
  • nginx rewrites the url from ipfs.io/refs/ to refs.ipfs.io/ and the gateway renders broken links for that
  • more non-dmca refs stuff to come!

[dignifiedquire]

Apps on IPFS

Agenda

Components all the things

• Modularized webui ipfs-webui#73
• https://github.com/ipfs/ipfs/issues/109

Time table for station release

Participants

• Friedel Ziegelmayer @dignifiedquire
• David Dias @diasdavid
• Johan Kiviniemi
• Juan Benet @jbenet

Notes

• Bug on 0.3.9 passed the tests cause there wasn't a way to test a long running node (due to use of disposable deamons). We should add one test to check this (or just run tests twice without cleaning up)
• station
• ipfs-api needs to be upgraded in station - https://github.com/ipfs/station/blob/master/package.json#L10
• go-ipfs needs an option to select the OS and Arch
• what needs to be done in order to have packaging working https://github.com/ipfs/station/blob/release/gulpfile.babel.js
• option on ipfsd-ctl to select the daemon in which to control
• npm orgs for IPFS
• Moved Component chat to its own slot later this week

[daviddias]

libp2p

Lead: David Dias

Agenda

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Participants

Jeromy Johnson
David Dias
Juan benet
Johan Kiviniemi

Notes

Jeromy is merging #1937 (Monday)
strip out libp2p out of go-ipfs (Monday)
Level up both implementations (JS and Go)
Sync up (Jeromy + David) on how to move go-libp2p to the new libp2p spec (probably happening Wednesday)
Keep working closely to node-webrtc, unblock webrtc-explorer
libp2p to be a first class citizen in the projects portfolio

[daviddias]

js-ipfs

Lead: David Dias

Agenda

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Participants

David Dias
Juan benet
Johan Kiviniemi

Notes

• expose an HTTP API
• run sharness tests on js-ipfs HTTP API
• Review IPLD document
• ASCII(Mazières) links

After sprint meeting is finished, create the respective action items on the Github sprint issue

[whyrusleeping]

@whyrusleeping TODO:

• merge transports changes
• rebase 0.4.0
• extract go-libp2p
• gx modularity and hooks
• merge add perf
  • rebased on 0.4.0
• go-datastore nosync flatfs
• addrsplosion part 4

[harlantwood]

I'm working on:

• CI build matrix & selected repo statistics ipfs-inactive/project-repos#1

[kyledrake]

@kyledrake:

• libp2p site
• continue on DMCA (ongoing)
• changes to blog post (ongoing)

[daviddias]

SPRINT CHECK IN

• libp2p
  • Go through IPLD spec
  • make a sync API for js-ipld add sync mode ipld/js-ipld-dag-cbor#8
• npm's registry on IPFS (on hold till 0.3.9 rebase on top of 0.4.0)
  • Release a working version of ipfs-blob-store with all of the new shiny things https://github.com/ipfs/ipfs-blob-store/releases/tag/v0.1.0
  • [~] download the entire npm - Almost there [470503/472177] as the time of this post !
  • Make registry-mirror https://github.com/diasdavid/registry-mirror
• js-ipfs-api
  • fix double recursive flag bug fix double recursive flag ipfs-inactive/js-ipfs-http-client#110
  • fix, make errors parsable again Make errors parsable again ipfs-inactive/js-ipfs-http-client#111
• extra
  • Organized and delivered a talk at the 1st IPFS Lisbon. People got very excited and we will probably have a second meetup December with a person from AWMN Mesh community that is doing his PhD in Lisbon + the maintainer of Unimos, the Portuguese large Meshnet, the goal is to have several people setting up OSLR and then use IPFS to distribute data. Will be looking for sponsorship to get cheaper routers.
  • Got invited for NodeConf Barcelona + Prepare presentation for NodeConf Barcelona
  • NodeKnockout Judge duties
  • Flew to Barcelona for the Weekend and attend IPFS Hack Fest Barcelona. Huge hi5 to @masylum and @victorbjelkholm for organizing it!

[RichardLitt]

@lgierth's sprint update

• go-ipfs
  • [~] RFCR fix gateway links with url rewrites gateway: add path prefix for directory listings kubo#1971 gateway: set X-Ipfs-Gateway-Prefix header infra#116
  • deploy dev0.4.0 to castor and pluto Run go-ipfs dev0.4.0 on pluto and castor infra#115
• infrastructure
  • fix restarter ipfs/infra@6dfef4b
  • update ansible solarnet: update ansible infra#114
  • remove ipfs logging config, was thought to be broken, but actually removed! repo: remove Log config kubo#1959
  • [~] open up cors on gateways (allow origin *) gateway: open up CORS to everything (allow-origin *) infra#109
  • .h.ipfs.io pointing to cjdns addresses
• refs
  • dmca yyyy/mm/dd structure dmca: create /yyyy/mm/dd structure ipfs-inactive/refs#4
  • writeup for kyledrake https://asciinema.org/a/7wgjaa5co0oo1lft5l1tvws43 (the api key in there has since been revoked, my bad)
• cjdns
  • update to latest v17
  • [~] discover peers from cjdns WIP: discover peers from cjdns kubo#1316
  • [~] invite to fc00 development (aka go-cjdns)
• org stuff
• hope
  • plan for community pinning / pincoop Community Pinning / PinCoop infra#113
  • plan for writable gateway Making ipfs.io gateway writable infra#105

[RichardLitt]

@victorbjelkholm's update:

Many things to do over at Typeform, got some time to spend on IPFS though...

Update

IPFS in JS

• Finish writing docs and API docs (Still haven't pushed the branch for this, will do tonight!)
• Help out to finish the API.md for js-ipfs-api
• working on node-ipfs-api to pass the tests in browser + node env (didn't help very much with this...)

PinCoop - https://github.com/victorbjelkholm/pincoop

• Rename to PinCoop
• having PinCoop ready for public consumption, mainly to scratch my own need for ipfsbin
• Finish prototype with pull-model (did at the IPFS hackday)

IPFSBin - https://github.com/victorbjelkholm/ipfsbin

• new ui for ipfsbin to be able to select language amongst other things
• start using PinCoop for ipfsbin, to make content more available

nodejs version hosting on IPFS - https://github.com/victorbjelkholm/nodejs-mirror

• Deploy
• Download all versions
• Publish
• Write blog post about it https://gist.github.com/VictorBjelkholm/af38baab3728414ab478

Community

• [~] preparing talk for local meetups here in Barcelona
• collecting things for awesome-ipfs showcase
• Barcelona hack day with IPFS and Redbooth

[RichardLitt]

My update:

I did not have a good on-keyboard week this week, at all. I was AFK for most of it. I feel poorly about that.

IFPS HTTP docs

• Automatically populate a basic template as a one-off seed. Perhaps use Auto generate API.md using mocha ipfs-inactive/js-ipfs-http-client#105.
• Put a Swagger info bloc in ipfs/api.
• Look at httpie
• Document how to use curl for your own use to figure out what is missing in the API docs.
• Add a PR to ipfs.io/docs/api about how the commands there are not all-inclusive.
• Get ipfs add documented.
• Stub out the rest.
• Respond to "What's up Doc?" ipfs-inactive/http-api-spec#1.

READMEs

• Parse IPFS readme's automatically using a CLI tool for ipfs-readme-standard.
• CR on @victorbjelkholm's Add current work in progress of readme.md and api.md ipfs-inactive/js-ipfs-http-client#102
• Help with CI build matrix & selected repo statistics ipfs-inactive/project-repos#1 and CI build monitoring (build matrix) infra#25.

Community

• Add ipfs/ci-status to PD.md. Added ci-status ipfs#123
• Sprint management.
• Go through and move ideas from some sprint changes #43 into ipfs/pm/README.md. Updated the README to include points from #43 #52
• Edit ipfs/community/blob/master/docs/amending-commits.md. Edited amending-commits doc. Added a TOC, improved language community#70
• Respond to issue about community infrastructure for meetups.
• Make the documentation around Commit Sign-Offs more friendly
• Template out issue reporting file from Issue Reporting Guide kubo#1946.

Added Done

• Updated project-directory.md PR Project Directory cleanup ipfs#116
• Talked a lot about community entry pointes, added various tasks to my TODO. Cf Discourse - Better community building community#69

[RichardLitt]

@whyrusleeping sprint update:

• merge transports changes
• rebase 0.4.0
• extract go-libp2p
  • still working on vendoring everything nicely
• gx modularity and hooks
  • lots of gx fun
• merge add perf
  • rebased on 0.4.0
• go-datastore nosync flatfs
• addrsplosion part 4
• dht query profiling
  • kbucket nearest peers fix
  • dht query perf fixes (waiting to PR)
  • swarm dial backoff more aggressive (code complete)

[RichardLitt]

@dignifiedquire's update:

• [~] Start mirroring npm-registry
• [~] Investigate and improve performance for reginabox and related modules Add batch processing to improve performance davglass/follow-registry#10
• Refactor js-ipfsd-ctl and add ability to select a specific ipfs binary (needed for station packaging) Cleanup, refactor and configurable executable js-ipfsd-ctl#33
• Make ipfs-geoip more resilient Small fixes ipfs-shipyard/ipfs-geoip#4
• Use pretty print from ipfs-geoip in webui Use lookupPretty from ipfs-geoip ipfs-webui#93

[RichardLitt]

@kyledrake:

• libp2p site
• [~] continue on DMCA
• changes to blog post

I may be late for the sprint but will be joining the infrastructure hangout.

[RichardLitt]

Note: Pasted these above because I accidentally directed everyone to the wrong thread. My bad!

[jbenet]

@jbenet

• ethereum devcon1 -- this ate all of my time. talks, meeting with users and more.
  • ipfs talk and related conversations
  • 3x interviews about ipfs
  • many conversations. some with:
    • EthDev
    • Consensys
    • Augur
    • Eris
    • other smart contract + ipfs users
    • Floppy (James) at ODI
    • Ira from Redecentralize
    • Rufus from OKFN
• IPFS London Meetup

[ion1]

Update:

• [~] Slight progress with Gateway: Add Cache-Control/max-age and ETag to IPNS requests kubo#1921, more work remains to be done.

[masylum]

Sprint Check in

• community
  • Co-organized the first Barcelona IPFS meetup. People had a lot of fun and got their hands into it.
• libp2p
  • [~] Started to work on js-libp2p-repo, compatible with abstract-blob-store which means that we will be able to have ipfs repositories on ipfs repositories on ipfs (you get it).