Search, Big Data, Analytics, Natural Language Processing
January 8, 2013 3 Comments
In previous posts, all listed below, we’ve discussed general architecture, full text search capabilities and facet aggregations possibilities. However, till now we have not discussed any of the administration and management options and things you can do on a live cluster without any restart. So let’s get into it and see what Apache Solr and ElasticSearch have to offer.
December 24, 2012 1 Comment
HBaseWD is aimed to help distribute writes of records with sequential row keys in HBase (and avoid RegionServer hotspotting). Good introduction can be found here.
We recently published 0.1.0 version of the library to Sonatype public maven repository. Thus, integration in your project became much easier:
<repositories>
<repository>
<id>sonatype release</id>
<url>https://oss.sonatype.org/content/repositories/releases/</url>
</repository>
</repositories>
<dependency>
<groupId>com.sematext.hbasewd</groupId>
<artifactId>hbasewd</artifactId>
<version>0.1.0</version>
</dependency>
HBaseHUT is aimed to help in situations when you need to update a lot of records in HBase in read-modify-write style. Good introduction can be found here.
We recently published 0.1.0 version of this library to Sonatype public maven repository too. Integration info:
<repositories>
<repository>
<id>sonatype release</id>
<url>https://oss.sonatype.org/content/repositories/releases/</url>
</repository>
</repositories>
<dependency>
<groupId>com.sematext.hbasehut</groupId>
<artifactId>hbasehut</artifactId>
<version>0.1.0</version>
</dependency>
For running (MR jobs) on hadoop-2.0+ (which is a part of CDH4.1+) use 0.1.0-hadoop-2.0 version:
<dependency>
<groupId>com.sematext.hbasehut</groupId>
<artifactId>hbasehut</artifactId>
<version>0.1.0-hadoop-2.0</version>
</dependency>
Thank you to all contributors and users of the libraries!
December 6, 2012 1 Comment
We are happy to announce the General Availability of SPM, our performance monitoring solution for Apache Solr, ElasticSearch, HBase, SenseiDB, and Java applications, and of course all system metrics. You can also vote for what else you want SPM to monitor. Over the last N months that we’ve been running SPM we’ve received a lot of good feedback (thanks!), a lot of words of encouragement (thanks!), and even a few nice quotes (another thanks!). Here is one from Jerry Yang, a Software Engineer at Walmart Labs: “I have been using SPM for couple of days and it has been amazing. I learned a lot about my Solr services and was able to optimize based on the results on SPM. Great work.”
Since holiday season is coming up, we thought we’d offer some discounts every week between now until the end of the year. Each of the following discounts can be used only during “its week” specified below. There is a limit to the number of people who can use each discount, so if you want it, don’t waste too much time. Each discount will reduce the price of SPM SaaS for 365 days after you’ve used it, which effectively means you will get discount until the end of 2013. Note that when you register for SPM you do not need to enter your credit card information. You also don’t need to provide it when you create the SPM application for the system you want to monitor. And it is when you create your SPM application that you can enter the discount code.
Note that each discount code expires on Sunday at 00:00 UTC.
The above discounts are good for our SPM SaaS. However, if you’d rather run SPM on your own servers, we do offer SPM on Premises – please get in touch if you are interested in the on premises version. You can also vote for SPM SaaS vs. On Premise and that way tell us which version you prefer or want.
There are a few different subscription plans available in SPM SaaS:
If you have not used SPM before, here is what you can expect to see – click on the image to see a large, non-fuzzy version:
We hope you will find SPM useful and fun to use. We are always looking for feedback – just email spm-support@sematext.com or ping @sematext and tell us what you like or don’t like about SPM.
November 8, 2012 2 Comments
Slides for the Battle of the Giants talk Rafał Kuc (@kucrafal) gave at ApacheCon EU 2012 are now up!
If you like working with Solr and/or ElasticSearch, or HBase, Hadoop, Kafka, Flume, etc., use and/or develop highly scalable distributed applications and frameworks, if you like to work on Analytics and Big Data applications and services, we’re looking for good, smart, and fun people!
And if you liked the above presentation, you may also want read our ElasticSearch vs. Solr series and see Scaling Massive ElasticSearch Clusters.
October 30, 2012 2 Comments
Solr 4 (aka SolrCloud) has just been released, so it’s the perfect time to continue our ElasticSearch vs. Solr series. In the last three parts of the ElasticSearch vs. Solr series we gave a general overview of the two search engines, about data handling, and about their full text search capabilities. In this part we look at how these two engines handle faceting.
October 1, 2012 12 Comments
In the last two parts of the series we looked at the general architecture and how data can be handled in both Apache Solr 4 (aka SolrCloud) and ElasticSearch and what the language handling capabilities of both enterprise search engines are like. In today’s post we will discuss one of the key parts of any search engine – the ability to match queries to documents and retrieve them.
September 25, 2012 1 Comment
When you are obsessed with performance and run a performance monitoring service like Sematext does, you need a quick and easy way to inspect Java apps’ MBeans in JMX. We just open-sourced JMXC, our 1-class tool for dumping the contents of JMX, or specific MBeans. This is a true and super-simple, no external dependencies console tool that can connect to JMX via Java application PID or via JMX URL and can dump either all MBeans or those specified on the command line.
JMX lives at https://github.com/sematext/jmxc along with other Sematext open-source tools. Feedback and pull requests welcome! Enjoy!
