Run FAST to Open-Source Search

Ever since Microsoft announced they are halting all development of FAST for Linux starting now, every single organization involved in search had something to say on this topic.  Here are our thoughts on that.

Apparently 80% of FAST users are Linux users.  We won’t speculate what is really behind this seemingly crazy decision to turn off the FAST@Linux dollar faucet.  Over at Kellblog, the Mark Logic CEO already itemized whose door the current FAST@Linux customers might want to knock on next depending on what they are using FAST for.  Unfortunately, he forgot one important angle there, one key option for FAST@Linux users that in today’s day and age should absolutely not be ignored.  After every storm comes sunshine.  The same is happening here.  While being forced to start thinking about changing one’s search solution probably isn’t pleasant, it does open another important door, a big opportunity, one should not ignore. The question we would pose FAST customers is the following: Is there something you’ve always wanted to do with FAST, but never could?  Here is your chance to change that! That door that just opened… walk through it, take look around, you just may like it.  Read on.

While FAST@Linux users may be experiencing mental turbulence now, they know there are open-source tools and solutions out there that are more scalable and faster than FAST and don’t involve any crazy per-document, per-query, per-xyz licensing fees.  (The part about superior performance is referring to Lucene and solutions built on top of it, like Solr.  Several years ago the former C*O of FAST called me up with a search business proposal.  One of the bits he mentioned is that his/FAST engineers were testing Lucene and found it faster than their own search components.) More importantly, these tools are completely open and give FAST@Linux customers the opportunity to finally get whatever they could never get from FAST.  Sure, there will be some trade-offs (e.g. some of these tools may not have some of the nice GUI pieces FAST has, but that is changing…eh, fast).  But the key bit is that these tools are not only free to get and use, they are nearly infinitely flexible.  They have their source opened to all the eyeballs of the world.  They have open-minded communities (or at least the ones we are involved in at Apache Lucene, Solr, Nutch, etc. are).  Development plans are all an open book.  Any organization’s engineers are welcome to jump in and either contribute (nearly finished) new components, or collaborate to develop new functionality, or simply explain user-cases and request functionality to support them, or even fork the whole project.  One would be crazy to choose the last option, of course – it would be sub-optimal use of the benefits of choosing an open-source solution.  Flexibility is one of the key benefits of using open-source.  You don’t like relevance is computed?  Plug your own secret sauce!  You don’t like how data is stored on disk?  Change it to your liking!

If you have to get off FAST@Linux in the coming years, think very, very, VERY hard before you go to another closed enterprise search vendor.  By going to another closed enterprise search vendor, what have you achieved?  You may be able to do what you never could do with FAST before, but there might be some other functionality you’ll have to give up because the new vendor does not have it, does not plan on having, and that you cannot add yourself because most of the solution is a black box with tiny holes poked on some of its sides, so you can kind of take a pretend peek inside.  This would not be an improvement.  This would be a missed opportunity!

Here are some of the key benefits of going with open-source search tools and solutions:

  • No up-front fees
  • No increasing fees due to growth
  • Flexibility to change anything and everything
  • A large and growing user and development communities
  • Security of commercial-grade support

Microsoft’s decision to drop FAST development for Linux is a blessing in disguise. It may not be pleasant right now, but it is actually a good opportunity for FAST customers.  Choose wisely now and in the coming years, and avoid being put on the spot again.

Update: after posting this we came across a blog post that refers to a search service switching from FAST to Solr and cutting costs 400%.  That is, the cost of their new Solr-powered search is 25% of the cost of their old FAST-powered search.

6 Responses to Run FAST to Open-Source Search

  1. Let’s hope that this entry is widely read and heeded. I agree with you 100%.

  2. Fabio Curti says:

    We are starting with a pilot project using Solr. It will be a good and interesting opportunities to see Solr in action vs FAST.

  3. Welcome to the land of sunshine, Fabio!

    Years ago (3? 4?) I helped a well-known US company, a nation-wide cable TV and broadband provider among other things, compare FAST vs. Solr. Solr won easier than I had expected. Since then Solr has grown by leaps and bounds.

  4. Fabio – what made you even consider Solr, since you are already a FAST user and customer?

  5. Charlie says:

    I agree with you as well: we already have information from some major FAST users that they’re considering the various open source alternatives, including our Flax platform and Lucene/SOLR. This move by Microsoft will have a major impact on the enterprise search landscape.

  6. Burk says:

    Indeed , I too agree to it. Still, for the FAST users I would rather call it a disguised sort of an option available. It gives them an opportunity to explore other enterprise search platforms like Solr ,which are steadily making their mark in the open source world. Infact , Solr even caters to some of the shortcomings of FAST . I referred to Solr’s reference guide for clear understanding of the concept at

    http://www.lucidimagination.com/Downloads/LucidWorks-for-Solr/Reference-Guide

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 1,695 other followers

%d bloggers like this: