How to bootstrap your 1st search product

How to bootstrap your 1st search product

Search functionality has become ubiquitous in today's digital landscape. If you're a founder, have you ever wonder how to integrate that magical ability into your own product? Look no further! I've compiled a list of potential solutions that you can leverage to develop your very first search product. If you're eager to learn more or curious about which solution best fits your needs, feel free to connect with me. I'm here to help you bootstrap your search product journey! ??

Option 0: Leverage the existing data storage for your search case by adding indexes?

Can your existing database handle it? Do you really need a search engine?

Option 1: Buy existing search solution

Buying existing Search as a service. Example: Agolia

Pro:

Easy to onboard and let the team focus on solving the real business problem

Con: High costs, low customization.

Option 2: Leverage Elasticsearch

By leveraging ES, you can build your own search stack by either deploying your own on prem ES cluster or using the hosted solution. It expose Restful APIs for developer to provision, index, search documents

Pro:

Restful APIs is easy to use and covers most of your search case

Con:

Scoring pipeline

Near real time

Hard to customize?

Reference:

https://doordash.engineering/2021/07/14/open-source-search-indexing/

https://medium.com/berlin-tech-blog/building-a-home-feed-with-kafka-streams-and-elasticsearch-894bd5e9b80d

Option 3: Build your inhouse Search Engine on top of Lucene

Pro:

Customize everything from how data is stored(partition/sharding) to how we search diff segment

Con: Lots of engineering efforts to build?

Reference:

https://engineeringblog.yelp.com/2021/09/nrtsearch-yelps-fast-scalable-and-cost-effective-search-engine.html

https://doordash.engineering/2024/02/27/introducing-doordashs-in-house-search-engine/

About the Author: Yijie brings over 6 years of experience in designing large-scale distributed systems and specializes in crafting cutting-edge search solutions. His expertise lies in building search products, ranging from ElasticSearch implementations to customized Lucene search engines.

Stefano Passarello

Accountant and Tax expert | Crypto Tax Specialist | Board Member | Co-founder of The Kapuhala Longevity Retreats

11 个月

Fantastic insights??! ??Starting a search product from scratch gets fascinating as well as challenging. You make excellent suggestions about using Elasticsearch and other similar tools for AI-driven ranking.???? It is imperative that entrepreneurs grasp these tactics in order to gain a competitive advantage ?? Agree Yijie Wu ?

回复

要查看或添加评论,请登录

Yijie Wu的更多文章

社区洞察

其他会员也浏览了