How Nominatim Update actual works

[utsavihirani16]

My nomiatim service running properly.
everything working fine but data not updated since last 2 months.

I have run "nominatim replication --once" command it started updating data for almost 15 days then it show following line in error.log file.

Update completed. Import: 0:27:24. Indexing: 0:51:38 Total: 1:19:03. Remaining backlog: 77 days, 3:44:58.

What does it mean .How can I start further

Thanks in an advance

[lonvia]

What data did you import? What is your configured replication source?

[utsavihirani16]

postgres=# select count() from placex;
ERROR: relation "placex" does not exist
LINE 1: select count() from placex;
^
postgres=# select * from import_osmosis_log order by batchend desc limit 15;
ERROR: relation "import_osmosis_log" does not exist
LINE 1: select * from import_osmosis_log order by batchend desc limi...

[mtmail]

Login to the Nominatim database first. Try psql nominatim. psql -l should tell you which database you have.

[utsavihirani16]

nominatim=# select count(*) from placex;
count

82875731
(1 row)

nominatim=# select * from import_osmosis_log order by batchend desc limit 15;
batchend | batchseq | batchsize | starttime | endtime | event
---------------------+----------+-----------+----------------------------+----------------------------+--------
2024-05-16 14:27:09 | 6092190 | | 2024-08-01 16:53:04.384834 | 2024-08-01 17:20:29.311205 | import
2024-05-16 14:27:09 | 6092190 | | 2024-08-01 17:20:29.35111 | 2024-08-01 18:12:07.686884 | index
2024-05-16 12:05:33 | 6092049 | | 2024-08-01 15:57:58.989836 | 2024-08-01 16:53:04.353935 | index
2024-05-16 12:05:33 | 6092049 | | 2024-08-01 15:30:06.645829 | 2024-08-01 15:57:58.956765 | import
2024-05-16 09:10:28 | 6091878 | | 2024-08-01 14:41:13.349919 | 2024-08-01 15:30:06.608915 | index
2024-05-16 09:10:28 | 6091878 | | 2024-08-01 14:16:15.916973 | 2024-08-01 14:41:13.287565 | import
2024-05-16 05:08:32 | 6091640 | | 2024-08-01 13:45:24.050675 | 2024-08-01 13:59:57.045854 | import
2024-05-16 05:08:32 | 6091640 | | 2024-08-01 13:59:57.074947 | 2024-08-01 14:16:15.908354 | index
2024-05-16 02:15:04 | 6091470 | | 2024-08-01 13:06:02.027509 | 2024-08-01 13:45:24.030754 | index
2024-05-16 02:15:04 | 6091470 | | 2024-08-01 12:45:18.21824 | 2024-08-01 13:06:02.005909 | import
2024-05-15 22:42:29 | 6091261 | | 2024-08-01 12:00:21.263156 | 2024-08-01 12:45:18.203522 | index
2024-05-15 22:42:29 | 6091261 | | 2024-08-01 11:38:52.188555 | 2024-08-01 12:00:21.25104 | import
2024-05-15 19:58:45 | 6091102 | | 2024-08-01 10:45:00.91593 | 2024-08-01 11:38:52.177201 | index
2024-05-15 19:58:45 | 6091102 | | 2024-08-01 10:22:54.236841 | 2024-08-01 10:45:00.896745 | import
2024-05-15 17:34:14 | 6090962 | | 2024-08-01 09:05:43.324151 | 2024-08-01 09:27:16.379661 | import
(15 rows)

[mtmail]

batchseq are minutes. Both batchend and batchseq process about 3 hours worth of updates in one run. One run takes about 1 hour (difference of starttime and endtime, sum or import+index).

You're 77 days behind and it will take you more than 25 days to run all past updates. Probably takes 30-40 days.

It will be faster to delete the current database and do a full import instead.

[utsavihirani16]

@mtmail Thankyou so much for help .

I have another nominatim server which also behaves the same, In that i am not able to find .env file as well.
nominatim=# select * from import_osmosis_log order by batchend desc limit 15;
batchend | batchseq | batchsize | starttime | endtime | event
---------------------+----------+-----------+----------------------------+----------------------------+--------
2024-06-13 04:34:32 | 6130986 | | 2024-06-29 14:35:34.010331 | 2024-06-29 14:46:45.167667 | index
2024-06-13 04:34:32 | 6130986 | | 2024-06-29 14:30:47.013395 | 2024-06-29 14:35:34.000515 | import
2024-06-12 23:56:59 | 6130714 | | 2024-06-29 14:14:35.867208 | 2024-06-29 14:30:46.997237 | index
2024-06-12 23:56:59 | 6130714 | | 2024-06-29 14:09:12.869081 | 2024-06-29 14:14:35.860554 | import
2024-06-12 20:47:15 | 6130528 | | 2024-06-29 13:54:54.662433 | 2024-06-29 13:58:57.350425 | import
2024-06-12 20:47:15 | 6130528 | | 2024-06-29 13:58:57.368856 | 2024-06-29 14:09:12.852482 | index
2024-06-12 18:37:30 | 6130401 | | 2024-06-29 13:36:15.89871 | 2024-06-29 13:41:16.56596 | import
2024-06-12 18:37:30 | 6130401 | | 2024-06-29 13:41:16.573861 | 2024-06-29 13:54:54.637759 | index
2024-06-12 16:01:15 | 6130249 | | 2024-06-29 13:19:01.010033 | 2024-06-29 13:24:11.073261 | import
2024-06-12 16:01:15 | 6130249 | | 2024-06-29 13:24:11.086229 | 2024-06-29 13:36:15.886447 | index
2024-06-12 13:20:45 | 6130092 | | 2024-06-29 13:00:27.89241 | 2024-06-29 13:06:06.445644 | import
2024-06-12 13:20:45 | 6130092 | | 2024-06-29 13:06:06.454871 | 2024-06-29 13:19:00.994869 | index
2024-06-12 10:28:15 | 6129924 | | 2024-06-29 12:43:16.204327 | 2024-06-29 12:49:31.948445 | import
2024-06-12 10:28:15 | 6129924 | | 2024-06-29 12:49:31.969289 | 2024-06-29 13:00:27.857477 | index
2024-06-12 05:51:45 | 6129654 | | 2024-06-29 12:33:04.037833 | 2024-06-29 12:43:16.180693 | index
(15 rows)

nominatim=# select count(*) from placex;
count

50374113
(1 row)
so what can I do for
this second server ?

Thanks

[mtmail]

I explained how I calculated how long one run takes and how much data one run processes. This server is the same.

[utsavihirani16]

@mtmail ,I have to drop the database & import new one
Is there any reference link do you have so I can go through it & do it Or else any steps to perform this task.

Thankyou .

[mtmail]

https://www.postgresql.org/docs/current/app-dropdb.html , https://nominatim.org/release-docs/latest/admin/Import/