Spark vs. Hadoop: Talend 6 Offers Real-Time Big Data Analytics
Apache Spark integration and real-time big data processing headline the new features in Talend 6, the latest release of the open source big data platform, which is out this week.
Apache Spark integration and real-time big data processing headline the new features in Talend 6, the latest release of the open source big data platform, which is out this week.
Talend says the newest version of its platform, which comes in both a free, open source edition as well as a commercial, subscription-based one, is "the industry’s first and only data integration platform with native support for Apache Spark and Spark Streaming." Spark is a big data platform that focuses on in-memory computing, delivering much faster processing speeds than Hadoop-based big data tools in certain situations.
According to Talend, the Spark integration allows Talend 6 to support real-time big data analytics. "Now, for the first time, all the ingredients are coming together to form an integrated real-time big data supply chain that will transform how we do business," Talend CMO Ashley Stirrup said in a blog post announcing the Talend 6 release.
While the big feature in Talend 6 is extended Spark support, the company remains eager to work with customers accustomed to Hadoop-based big data jobs by converting them to Spark. Talend 6 can convert MapReduce workloads—the kind that usually involve Hadoop—to Spark jobs, "resulting in an immediate 5x performance increase," according to the company.
Talend also says that interface enhancements in the new release will speed work for big data engineers. Talend 6 "will improve developer productivity 10x as compared to hand-coding thanks to its intuitive design interface and prebuilt Spark components with automated 'no coding required' Spark code generation," the company said in a product announcement.
From the channel perspective, Talend's position is clear: It's betting that Spark is the future of big data, and Hadoop's day has come and gone.
About the Author
You May Also Like