Scrape vinmonopolet into elastic for autocomplete search of wine names #35

New Issue

2020-09-09T11:57:45Z

KevinMidboe commented

2020-09-09 11:57:45 +00:00

(Migrated from github.com)

Idea

We want to have a autocomplete search field for wine names when searching for new wines to request. Vinmonopolet does not offer a good way to use their existing functionality for this. Make a job that scrapes all products and pushes them to a elasticdatabase.

Elastic chosen here for it's speed for free text search.

Todo

Create a /scripts/importVinmonopoletToElastic.js for scraping and updating elasticsearch.
Setup elastic configuration files for defining custom location and/or index name.
Frontend should gracefully disable querying autocomplete if elastic not set up (e.i. local development).

## Idea We want to have a autocomplete search field for wine names when searching for new wines to request. Vinmonopolet does not offer a good way to use their existing functionality for this. Make a job that scrapes all products and pushes them to a elasticdatabase. Elastic chosen here for it's speed for free text search. ## Todo - Create a `/scripts/importVinmonopoletToElastic.js` for scraping and updating elasticsearch. - Setup elastic configuration files for defining custom location and/or index name. - Frontend should gracefully disable querying autocomplete if elastic not set up (e.i. local development).

LasseHaslev commented

2020-11-01 10:09:43 +00:00

(Migrated from github.com)

Here is the search API for Vinmonopolet https://www.vinmonopolet.no/api/search?q=proseccco. 🙌

Here is the search API for Vinmonopolet [https://www.vinmonopolet.no/api/search?q=proseccco](https://www.vinmonopolet.no/api/search?q=proseccco). 🙌

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: KevinMidboe/vinlottis#35