Products sync

[serpico]

[Raphael] Every afternoon we run a script to sync the OFF database (food, product, beauty, pet food + obsolete) with OP products.

Code

https://github.com/openfoodfacts/open-prices/blob/main/open_prices/common/tasks.py

Stats

Date	OFF + obsolete	OPF	OBF	OPFF	unknown
2024-12-04	3624143	15741	31463	9955	5484

Related issues

• Fetch non-food product data from Open Product Facts & Open Beauty Facts #114
• Also sync products that are no longer sold ("obsolete") #281
• Product synchronization issue #243 & Product synchronization issue #243 & Fix OFF daily product sync #465 & OFF daily product (OPF) sync didn't happen #551
• Product sync: use OFF's Redis stream to get live updates #620

[raphodn]

Sync issues (since migrating to Django)

I thought it was related to #407 ( feel free to close this is it's the case ) so I didn't raise this issue before, but it seems the products weren't synced for a while ( I saw 04/09/24 ). Symptom is similar to #315

indeed @serpico you are right, I'm facing some issues with the OxF product sync.
Since we migrated to Django, it's not working correctly.
The culprit is #376

I tried to do some corrections, last one a few days ago, but still no success..

[raphodn]

fyi I ran the OPF sync a few times manually, but not the others

[raphodn]

I created an issue to track this : #465

[raphodn]

also renaming the content in case someone stumbles on this :)

[raphodn]

fixed :)

[raphodn]

The OPF sync seems not to work anymore. Maybe due to the changes happening the openfoodfacts-server (and migrating all the flavors into one place)

[raphodn]

Opened an issue in Product Opener: openfoodfacts/openfoodfacts-server#11118

[raphodn]

@raphael0202 added a live sync with OFF's product changes 🎉 (#620)

Haven't tested yet !
In any case, with the current frontend, you need to refresh the page you're on to see the changes on the product card :)