progressive slowdown "ipfs add file"

[fann95]

Version information:

go-ipfs version: 0.4.19-
Repo version: 7
System version: amd64/linux
Golang version: go1.11.5

Type: bug

Description:

I tested adding a large number of files and noticed a progressive slowdown in this operation.
my script added about 20,000 files in the first hour of work
in the next 4 hours, only 50,000 and the speed continued to decrease

#!/bin/bash

for (( i=1; i <= 500000; i++ ))
do
dd if=/dev/urandom of=${i}random bs=$(shuf -i 5000-20000 -n 1) count=1
ipfs add --pin ${i}random
done

If you add a file using API, the speed decrease even faster.
if there are 150,000 pined files, the recording speed for API is about 10 seconds, if there are no pined files, then the speed is 0.1 seconds
there is a progressive slowdown

[leerspace]

I think this is a duplicate of #5221

[hsanjuan]

@fann95 please follow up on #5221. Thanks!