What's New in Timeplus: Announcing GA of Timeplus Enterprise v2.6, and updates in Timeplus Proton
Hear Timeplus Enterprise updates from our Co-Founder and user cases from our customer. See the full recording of our Timeplus Live monthly webinar.
Timeplus Enterprise v2.6 is now Generally Available! In this release, we introduce a revolutionary Hybrid Hash Table to significantly reduce memory consumption for high cardinality data streams for joins and aggregations (for example, from 180GB to 20GB). This also enables more concurrent Materialized Views running in the Timeplus with reasonable costs. Other key enhancements include enhanced operational visibility, cross-deployment integration, as well as performance improvements and an enhanced user experience.
As we shared in our January Timeplus Live webinar, Timeplus partnered with RocNet Supply, Inc. to monitor network telemetry data with SQL-based processes and Grafana visualization.
"Using Timeplus and Grafana together has been awesome! Timeplus simplifies what was a delicate manual transform process into an automatic SQL-based process."
– Jason Patterson (Director of Network Architecture, RocNet Supply)
Timeplus Enterprise v2.6 is available through our fully-managed cloud service or can be installed on various infrastructures, including bare metal, Docker, and Kubernetes.
Read on to learn what's new:?
#?? Revolutionary Hybrid Hash Table for join and aggregations
?? Enhanced operational visibility
?? Performance improvements
?? Improved data management
?? Quick search/access in Timeplus Web Console
?? Redesigned SQL Console
?? Timeplus Grafana Plugin v2.1
?? Plus, what's new in Timeplus Proton
Revolutionary Hybrid Hash Table
The default in-memory hash table for table JOIN can easily consume a lot of system memory, especially for cases with millions or billions of events. With the new Hybrid Hash Table in Timeplus Enterprise 2.6, both the system memory and the local disk are used to store the internal state as a hash table, while still showing real-time streaming aggregation results every second. For example:
SELECT account_id, sum(total) as total?
FROM transfers?
GROUP BY account_id?
EMIT PERIODIC 1s ON UPDATE
SETTINGS default_hash_table=’hybrid’;
Enhanced Operational Visibility?
Gain complete transparency into your system's performance through comprehensive monitoring of materialized views and streams. Track state changes, errors, and throughput metrics via system.stream_state_log?and system.stream_metric_log. Those metrics are available as Prometheus endpoints, and you can also query them using SQL.
For example, the following SQL will show the read/write throughput for each data stream in Timeplus for the past 5 minutes:
SELECT
name,
avg((read_bytes / elapsed_ms) * 1000) AS read_bps,
avg((read_rows / elapsed_ms) * 1000) AS read_eps,
avg((written_bytes / elapsed_ms) * 1000) AS written_bps,
avg((written_rows / elapsed_ms) * 1000) AS written_eps
FROM table(system.stream_metric_log)
WHERE elapsed_ms > 0 and _tp_time > now()-5m
GROUP BY name;
Performance Improvements?
In this release, we pushed our unparalleled performance to a new level.
For example, one of our customers needs to write billions of rows to ClickHouse. With Timeplus Enterprise v2.5, the write throughput was ~3 million rows per second. Now in Timeplus Enterprise 2.6, we enhanced the connection pooling and other mechanisms. The same SQL pipeline can achieve 3.6 million per second throughput.
Improved Data Management
New in this release, you can add new columns to an existing stream or truncate the data in a stream without recreating it. Timeplus Enterprise 2.6 also supports multiple database namespaces. You can organize your streams, materialized views, and other objects in different databases.
Last but not least, you can create a materialized view and use Timeplus External Stream?as the target. This allows you to continuously write data to a remote Timeplus Enterprise or Timeplus Proton after stream processing.
UI Improvements in Timeplus Web Console
We added a shortcut to quickly access any objects or resources in Timeplus. Press Command+K on macOS or Control+K on PC to see quick actions, or search for an object.
We have also taken feedback from our community and redesigned the SQL Console. The updated layout allows you to write longer SQL statements and quickly access to the stream schemas, common functions, query history, or bookmarks.
We have also added new UI wizards for Coinbase...
...and Apache Pulsar.
Also for data integrations, the demo data generator is now powered by the native Timeplus Random Stream. You can customize the SQL to adjust the events-per-second or customize the data generation logic.
Timeplus Grafana Plugin v2.1
Along with the release of Timeplus Enterprise v2.6, we’re thrilled to announce the release of Timeplus Grafana Plugin v2.1, with the following enhancements:
Jason Patterson, Director of Network Architecture at RocNet Supply, demonstrates how he uses the latest Grafana plugin to apply network streaming telemetry. Watch the webinar recording to learn more.
Recent Updates in Timeplus Proton
For more details about our latest releases, please see release notes in our docs.
?? More Resources from Timeplus
Learn more about new features in Timeplus Enterprise v2.6 in this announcement blog by our Co-Founder 钟钱杰 . Read Blog
Jove also hosted our January Timeplus Live webinar, inviting special guest Jason Patterson (Director of Network Architecture at RocNet Supply, Inc. ) to share his use case. Watch Webinar Recording
Say bye to constantly refreshing dashboards. Our Timeplus and Grafana Labs plugin v2.1 keeps your SQL query results always up-to-date. Read Blog
??? Ready to start building?
??? Self-Hosted Timeplus Enterprise v2.6.0 is the current stable build (Public GA). See installation options and download a 30-day free trial.
?? Looking for a fully-managed solution? Try Timeplus Enterprise (Cloud) with a 14-day free trial. Create your free workspace
?? See Timeplus in action: Explore our demo workspace with live data.
? Visit Proton GitHub repo: github.com/timeplus-io/proton
?? Have questions or comments for us??Get in touch?to discuss your unique use cases.
Subscribe to our newsletter to learn more about streaming analytics with Timeplus.