I want to index many millions of documents from MongoDB. My plan so far:
- export from MongoDB to hundreds of CSV files
- in parallel for each CSV file, run
indexer
withcsvpipe
source to create plain index - Somehow attach all plain indexes to RT index
Any advice how to do 3 without modifying global config multiple times? Or any other way to easily merge hundreds of plain indexes created by indexer
s?