Skip to content

Luna_Streaming_4.0_Release_Notes.md

Latest commit

 

History

History
1943 lines (1671 loc) · 196 KB

Luna_Streaming_4.0_Release_Notes.md

File metadata and controls

1943 lines (1671 loc) · 196 KB
Raw

Release notes for DataStax Luna Streaming Distribution

About DataStax Luna Streaming Distribution

Luna Streaming Distribution 4.0 is compatible with Apache Pulsar™ 4.0 and subsequent releases.

Components

  • DataStax Luna Streaming (Apache Pulsar 4.0 fork)
  • DataStax BookKeeper (Apache BookKeeper fork)
  • DataStax Burnell
  • DataStax Pulsar Admin Console
  • DataStax Pulsar Heartbeat
  • DataStax Apache Pulsar Cassandra Sink
  • DataStax Apache Pulsar Cassandra Source
  • DataStax Starlight For Kafka
  • DataStax Starlight For RabbitMQ
  • DataStax Starlight For JMS Broker filter
  • DataStax Snowflake connector

This release adds these features to the original Apache Pulsar 4.0 release:

  • Stability improvements
  • Third party libraries updates for security fixes
  • Dependency upgrades (for security, stability and performances)
  • An enhanced ElasticSearch Pulsar IO Sink
  • An enhanced version of Apache BookKeeper with security fixes

Note: The DataStax Luna Streaming Distribution is designed for Java 17. However, because the product releases Docker images, you do not need to install Java (8 or 17) in advance. Java 17 is bundled in the Docker image.

Security

Luna Streaming is developed with great attention to security.

Since it is based on Apache Pulsar™, Luna Streaming Pulsar distribution has all the security processes and requirements required by the Apache Software Foundation™, such as:

  • Peer to peer code reviews.
  • Clear process for handling possible security vulnerabilities.

On top of that, Luna Streaming development processes are enhanced with additional security best practices for all the components involved:

  • Robust Continuous Integration and reproducible Release pipeline in a secure monitored environment. Such monitoring improves the overall security of the application.
  • Reactivity to third-party vulnerabilities. Every component is scanned and monitored daily, ensuring quick fixes in case of vulnerability disclosure.
  • Regular docker images vulnerability scans on latest Luna Streaming releases, with a well-defined release procedure.

Packaging

Luna Streaming Distribution comes with different packages tooled for different purposes. The distributions are available as Docker images and tarballs, and both methods follow the same packaging patterns.

Patterns

  • lunastreaming: the basic Luna Streaming Distribution including Pulsar SQL feature.
  • lunastreaming-core: the basic Luna Streaming Distribution without Pulsar SQL feature. Pick this distribution if you don't need Pulsar SQL features.
  • lunastreaming-all: contains the Core Luna Streaming Distribution, including Pulsar Offloaders and the DataStax Pulsar IO Connectors listed above. Pick this distribution if you want the DataStax connectors or the offloading feature.

Releases

Luna Streaming Distribution 4.0.13 0

This is a maintenance release containing important security updates and bug fixes for Luna streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • eda2c066768 Release 4.0.13.0
  • 6f218d0e199 License: Updated the required opentelemetry package version in LICENSE.bin.txt
  • 7169a542387 License: Added the required yawk version to the LICENSE.bin.txt
  • 319fc7b9037 Upgrade bookkeeper to 4.17.1.0.0.7
  • 54c2633ccc9 [fix][meta][branch-4.0] Tolerate concurrent creation of the underreplication LAYOUT node (#26248)
  • 43e27d9e2df [fix][broker] Release entry on GetLastMessageId when parseMessageMetadata throws (#26089)
  • d9fad851b8d [fix][broker] Prevent stale service unit callbacks from dropping active lookup and cleanup jobs (#26146)
  • 739bcde8cf5 [fix][broker] Fix TableViewLoadDataStoreImpl close deadlock that stalls broker shutdown (#26243)
  • 60217386591 [fix][client] Fix unAckedMessageTracker cleanup on multi-topics batch ack (#26001)
  • 1ba9b7bc40e [fix][fn] Forward source message properties in Python runtime (#26191)
  • 5f3a59ec261 [fix][broker] Fix silently dropped acknowledgement failures in PulsarMetadataEventSynchronizer (#26237)
  • df8ec2aed22 [fix][broker] Fix delayed message index data loss when trimming overlapping bucket snapshots (#26240)
  • 589f1038947 [fix][broker] Fix incorrect listener URLs returned by ModularLoadManager lookups (#26245)
  • 5c787de2af0 [fix][build][branch-4.0] Fix spotbugs failure in OffloadPoliciesImpl
  • 39d92eca7d4 [fix][broker] Prevent completing replicated snapshot before marker publish (#26119)
  • a2a06a32113 [fix][broker] Prevent stale topic unload cleanup from removing active cache entries (#26145)
  • 7f20ff5a664 [fix][broker] Fix Key_Shared delivery stall when look-ahead triggers at the end of the topic (#26236)
  • e57fe3629f8 [fix][ml] Preserve ledger entries/size when transformLedgerInfo callback completes after a concurrent close (#26228)
  • 79197d19d46 [fix][broker] Prevent stale read completions from stranding Failover subscriptions (#26174)
  • 10706e627df [fix][meta] Complete handleMetadataEvent future exceptionally when the initial get fails (#26199)
  • 0f0e9fdfbc2 [fix][meta] Record get op stats on the correct completion branch in AbstractMetadataStore (#26201)
  • c203013afb2 [fix][meta] Fix RocksdbMetadataStore instanceId not advancing across restarts (#26218)
  • 744395c601a [improve][offload] Support credentials from offload policies for S3 and Aliyun OSS drivers (#26232)
  • 29ad2619703 [improve][misc] Upgrade Jetty to 12.1.11 (#26233)
  • 380033b8726 [fix][broker] Trigger max read position callback for messages published during transaction buffer recovery (#26234)
  • ef5cfa7ec5e [fix][broker] Check deliverAt before containsMessage in bucket addMessage (#26230)
  • 8866ef0d798 [improve][build] Upgrade docker base image Alpine to 3.24 (#26225)
  • 73e8244d263 [improve][misc] Upgrade to Alpine 3.23 (#25180)
  • 55f2abb5bf3 [improve][build] Upgrade slog to 0.10.0 (#26226)
  • bd9f79c5753 [improve][broker][branch-4.0] Trace the asynchronous tasks in logs when loading topics (#26163) (#26224)
  • 5c0058d5e4a [improve][misc][branch-4.0] Add CustomLog config for slog
  • 2733c5abe00 [fix][test] Fix flaky test testCompactionPriority (#26198)
  • b7bd9dcdd4c [fix][misc][branch-4.0] Make log4j pattern compatible with slog which got pulled in by Oxia client upgrade
  • 31cf0ff316b License: Updated the required opentelemetry package version in LICENSE.bin.txt
  • 06d7a426c84 Checkstyle: Removed Ununused import of GenericRecord
  • f218dfb3957 Fix binary license
  • c52324dd188 [fix][ci][branch-4.0] Fix OpenTelemetrySanityTest after Otel library upgrade
  • c08d4442d7d [fix][broker][branch-4.2] Fix admin API HTTP 400 FAIL_ON_TRAILING_TOKENS when a broker interceptor is loaded (#26223)
  • 1cb25a1ecfb [fix][fn] Return inputSpecs consumerProperties in function GET info (#26217)
  • 1b0886a0ec6 [fix][meta] Fix NPE in shouldIgnoreEvent when MetadataEvent options is null (#26200)
  • 1ce63b71080 [fix][broker] Prevent partition expansion from inheriting delayed-delivery bucket state (#26179)
  • 41f14aa46bd [improve][broker] Skip system cursor when check inactive cursor. (#26149)
  • 3f4f21f0163 [fix][client] Fix lookup permit double-release, waiting queue starvation and timeout-response races in ClientCnx (#26143)
  • 962d2fe0f38 [improve][meta] Upgrade Oxia client to 0.9.4 (#26193)
  • 0a445bc2292 [improve][meta] Upgrade Oxia client to 0.8.0 (#25964)
  • ffa661742c9 [fix][broker] Fix bucket delayed message index metrics reset on scrape (#26171)
  • 943284bc81f [fix][broker] Read subscription properties directly from cursor (#26159)
  • 306cd87aed3 [fix][client] Fix UnAckedMessageRedeliveryTracker to skip cancelled timeouts (#26043)
  • fecf4e6a7dd [fix][client] Sync ackSet in client with broker to stop acked messages reaching the DLQ (#26135)
  • c9e2f2442c4 [fix][ci] Upgrade sandboxed-trivy-action to approved sha (#26169)
  • 16a43b1f13d [improve][ci] Replace trivy-action with sandboxed-trivy-action (#25480)
  • 54daf296803 [fix][client] Fix lookup request semaphore not release problem (#25038)
  • ce5e90c33f3 Fix compile issue
  • 585b43eb3b7 Fix compile issue
  • c980f669fa5 [fix][broker] Fix getEstimatedSizeSinceMarkDeletePosition throw IllegalArgumentException (#26184)
  • 29df16fc584 [fix][client] Preserve null values in pulsar-admin schema output (#26196)
  • dff48923f3b [fix][sec][branch-4.0] Upgrade Hadoop to 3.5.0 (#26195)
  • 7f8114ad554 [improve][monitor][branch-4.0] Upgrade OpenTelemetry libraries (#26165)
  • 1d880e7994a [improve][monitor] Upgrade OpenTelemetry to 1.56.0, Otel instrumentation to 2.21.0 and Otel semconv to 1.37.0 (#24994)
  • 5a9ecd92474 [fix][sec][branch-4.0] Upgrade Netty to 4.1.136.Final (#26170)
  • 643223e5348 [fix][ci][branch-4.0] Skip testMarkReplicatedDeletesEmptyParentNodes for Etcd
  • fe02bc0ab30 [fix][metadata] Fix orphaned UR parent nodes not cleaned up with Oxia metadata backend (#26158)
  • 16a14239608 [fix][broker][branch-4.0] Fix NOT_FOUND for topic policy operations on idle non-persistent topics
  • 0485493ca7f [fix][sec] Bump github.com/go-jose/go-jose/v4 from 4.1.3 to 4.1.4 in /pulsar-function-go (#26142)
  • a4da1de0610 [fix][fn] Reorder Function Worker shutdown to stop scheduler before runtime manager (#26136)
  • c6054a96db5 [fix][sec] Upgrade pulsar-client-go to v0.20.0 in pulsar-function-go, also address CVEs (#26140)
  • cefe9eb19be [improve][fn] Upgrade pulsar-client-python to 3.13.0 (#26139)
  • 4ee98ed74d7 [improve][broker] Load topic policies on non-persistent topic load and gate the policy replay (#26134)
  • 6bbbc6f39a3 [fix][broker] Don't let a closing topic-policies reader abort a concurrent cache-init reload (#26132)
  • da1a60ae95a [fix][test] Run makeReadEntryProbFail's errorOrNot on a caller-provided executor (#26123)
  • 84df92fd477 [fix][test] Fix flaky PersistentTopicsTest setup caused by concurrent Mockito stubbing (#26083)
  • 2afd6bf3307 [fix][test] Fix flaky SchemaServiceTest.testSchemaRegistryMetrics (#25645)
  • 842d00e08e0 [fix][test] Fix flaky AuditorBookieTest.testBookieClusterRestart (#26122)
  • eeab93a6a33 [fix][broker] Fix replication stall when a cursor rewind skips an in-flight read (#26106)
  • eb9375d571e Revert "[improve][test]Add test: test/testTopicPartitionCannotBeCreatedAfterTopicDeleted (#26038)"
  • 415d6d7d097 [fix][broker] Forward topic policy updates after init failures (#26110)
  • 0ba46a0aba7 [fix][broker] Fix replicator getting stuck under rate limiter throttling and honor readBatchSize/maxReadSizeBytes on the default read path (#26005)
  • ffde42ad6d2 [improve][broker] Improve dispatch performance by summing entry bytes with a loop (#26055)
  • de472dcba7e [fix][broker] Guard BucketDelayedDeliveryTracker.nextDeliveryTime against empty queues (#26080)
  • ae736acfe88 [improve][broker] Trim orphaned bucket snapshots when ledgers are deleted (#25984)
  • f16c8c50a7b [fix][broker]Do not trigger topic GC if replication is still active (#25915)
  • bbf0c9f41ed [feat][broker] Expose managed ledger properties via topic internal stats (#26079)
  • 9aae6c65a8e [fix][broker] Avoid attaching a consumer to a migrated non-persistent topic on subscribe (#26075)
  • 67212580617 [fix][meta] Run ledger-underreplication notification callbacks off the metadata-store listener thread (#26065)
  • 83efe1f957a [fix][client] Run the failover health probe off the Netty event-loop thread (#26064)
  • ec4cda2d0c7 [fix][test] Make SameAuthParamsLookupAutoClusterFailoverTest less timing-sensitive (#25675)
  • 057c1c1a1c4 [improve][test]Add test: test/testTopicPartitionCannotBeCreatedAfterTopicDeleted (#26038)
  • fcd2bf3b5ea [fix][broker] Fix geo-replication stuck after a failed publish to the remote cluster (#26002)
  • f855f0c359d [fix] functions: Run worker leader-election off the consumer event-listener thread (#26059)
  • 3c779c451fc [fix][sec] Upgrade jline to 4.2.1 and picocli to 4.7.7, drop unused jline2 (#26068)
  • 8390f8f8241 [fix][broker] Avoid blocking the bundle-throughput lookup on per-bundle metadata reads (#26054)
  • 0b8ae2595bb [fix][broker] Avoid blocking the dispatcher close path on delayed-delivery tracker close (#26053)
  • 3c9f35d567e [fix][proxy] Avoid blocking the proxy IO thread on a cold broker cache (#26052)
  • 81e12abadae [fix][broker] Avoid blocking metadata read on the IO thread when redirecting migrated producers/consumers (#26051)
  • effd427cc83 [fix][broker] Prevent topic policy initialization race with a buffering listener wrapper (#26044)
  • 5cc4afbb3d9 [fix][test] Fix flaky testPrepareInitPoliciesCacheAsyncThrowExceptionAfterCreateReader (#26049)
  • ada7ecd6b6a [fix][broker] Run the message expiry check off the topic policy update path (#26040)
  • 8fcb18db6e5 [fix][broker] Run topic policy notifications on the topic-ordered executor (#26042)
  • 9e7371b30cc [fix][fn] Make exclusiveLeaderProducer volatile in FunctionMetaDataManager (#26046)
  • f214c5380ea [improve][fn] Upgrade pulsar-client-python to 3.12.0 (#26033)
  • 4b98f9c2785 [fix][broker] Fail fast for load balancer misconfigurations instead of falling back to SimpleLoadManagerImpl (#26031)
  • 315c6729b83 [fix][broker] Don't let a stuck or aborted topic policies cache init make a namespace's topics unloadable (#26025)
  • 735fa7c82d1 [fix][broker] Fix forced topic/namespace deletion still hanging when the compaction reader reconnect stalls (#26026)
  • 04c9a5ba5fe [fix][broker] Fix forced topic/namespace deletion hanging or failing when compaction is in progress (#26016)
  • 59e2e770608 [fix][broker] Prevent subscribe rate limit from stalling compaction and blocking forced deletion (#26015)
  • 97493733edd [fix][build][branch-4.0] Upgrade docker/setup-qemu-action to v4.1.0
  • a18d9ad8b10 [fix][meta] Keep the leader value in the election cycle and make leader reads authoritative (#26000)
  • bd8965bb7e0 [fix][broker] Fix compacted read could be stuck forever or message loss due to cursor mark delete (#25998)
  • 245aa92592d [fix][test][branch-4.0] Backport configurable read/add delays in PulsarMockBookKeeper
  • 70f1c697701 [fix][sec][4.0_ds] Fixing kotlin-stdlib dependency version for pulsar-io-kinesis with CVE-2020-29582 (#765)
  • 1ecfa8b00c5 Fix license headers after version upgrade
  • 6c7100fb7e3 [fix][sec][branch-4.2] Upgrade Jackson version to 2.18.9 (#26186)
  • f80f3f4233d [fix][test][branch-4.0] Adapt ConfigurationDataUtilsTest to Jackson 2.18.8 InetSocketAddress deserialization
  • 9a4d89b736f [fix][sec][branch-4.0] Upgrade Jackson version to 2.18.8 (#26098)
  • 8505ada4063 Start release 4.0.11.1-SNAPSHOT

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.10 pulsar-cassandra-admin-2.3.10-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.3 pulsar-jms-admin-9.0.3-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.3 pulsar-jms-9.0.3-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.8 pulsar-protocol-handler-kafka-4.0.3.8.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.4 starlight-rabbitmq-4.0.0.4.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.4 starlight-rabbitmq-4.0.0.4.nar
kafka Kafka Proxy Extension 4.0.3.8 pulsar-kafka-proxy-4.0.3.8.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.17 cassandra-enhanced-pulsar-sink-1.6.17-nar.nar
cloud-storage Writes data into cloud storage 3.2.10 pulsar-io-cloud-storage-3.2.10.nar
data-generator Test data generator source 4.0.13.0 pulsar-io-data-generator-4.0.13.0.nar
elastic_search Writes data into Elastic Search 4.0.13.0 pulsar-io-elastic-search-4.0.13.0.nar
http Writes data to an HTTP server (Webhook) 4.0.13.0 pulsar-io-http-4.0.13.0.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.13.0 pulsar-io-jdbc-clickhouse-4.0.13.0.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.13.0 pulsar-io-jdbc-mariadb-4.0.13.0.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.13.0 pulsar-io-jdbc-openmldb-4.0.13.0.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.13.0 pulsar-io-jdbc-postgres-4.0.13.0.nar
jdbc-sqlite JDBC sink for SQLite 4.0.13.0 pulsar-io-jdbc-sqlite-4.0.13.0.nar
kafka Kafka source and sink connector 4.0.13.0 pulsar-io-kafka-4.0.13.0.nar
kinesis Kinesis connectors 4.0.13.0 pulsar-io-kinesis-4.0.13.0.nar
lakehouse Lakehouse connectors 3.3.5.7 pulsar-io-lakehouse-3.3.5.7-cloud.nar
snowflake Snowflake Connector 0.2.6 pulsar-snowflake-connector-0.2.6.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.10 pulsar-cassandra-source-2.3.10.nar
data-generator Test data generator source 4.0.13.0 pulsar-io-data-generator-4.0.13.0.nar
debezium-mongodb Debezium MongoDb Source 4.0.13.0 pulsar-io-debezium-mongodb-4.0.13.0.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.13.0 pulsar-io-debezium-mssql-4.0.13.0.nar
debezium-mysql Debezium MySql Source 4.0.13.0 pulsar-io-debezium-mysql-4.0.13.0.nar
debezium-oracle Debezium Oracle Source 4.0.13.0 pulsar-io-debezium-oracle-4.0.13.0.nar
debezium-postgres Debezium Postgres Source 4.0.13.0 pulsar-io-debezium-postgres-4.0.13.0.nar
kafka Kafka source and sink connector 4.0.13.0 pulsar-io-kafka-4.0.13.0.nar
kinesis Kinesis connectors 4.0.13.0 pulsar-io-kinesis-4.0.13.0.nar
lakehouse Lakehouse connectors 3.3.5.7 pulsar-io-lakehouse-3.3.5.7-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.6 pulsar-ai-tools-3.2.6.nar
transforms Transformation function 3.2.6 pulsar-transformations-3.2.6.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0.11 0

This is a maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • b1ef88763d4 Update shell license
  • 93bf4c8b26a Revert opentelemetry version upgrade
  • 2f17b20d773 Exclude okio-jvm
  • 6c405c84559 Update jackson, postgresql, kafka-client and opentelemetry versions to fix CVEs
  • 3fbb66d467f [improve][misc] Upgrade Apache Commons libraries and Apache Http components (#25963)
  • 9bd8d850be7 [fix][test] Deflake TopicPoliciesTest.setupTestTopic by retrying forced namespace deletion (#25974)
  • 9a516645eca [fix][test] Fix flaky ExtensibleLoadManagerImplTest.initializeState by recovering wedged channel ownership (#25977)
  • fb1ebf40af8 [fix][test] Fix flaky ExtensibleLoadManagerImplTest by re-serving the channel topic in initializeState (#25976)
  • 6ff11020b33 [fix][broker] Fix tableview divergence in ServiceUnitStateTableViewSyncer causing flaky tests (#25946)
  • b2921a1aaa2 Update project.version to 4.0.11.0
  • 048d5c0f5b2 Fix build failure due to an old version of Caffine
  • 1620a3d80b8 [feat][broker] PIP-469: Legacy-aware topic policies backend routing and metadata-store topic policies (#25707)
  • 4255803f59e [feat][pip] PIP-469: Legacy-aware topic policies backend routing and metadata-store topic policies (#25547)
  • 81dc4a66941 [improve][misc] Upgrade Jetty to 12.1.10 (#25943)
  • b7de53cc63e [fix][fn] Fix orphan exclusive producer on creation timeout in WorkerUtils.createExclusiveProducerWithRetry (#25942)
  • 390a1eb0226 [fix][client] Preserve equals in FieldParser map values (#25907)
  • 00530b169ea [improve][client] Clean up unacked message tracker when topics are removed in multi-topic consumers (#25923)
  • 4948cf64520 [fix][client] Match logical topic when removing unacked messages (#25921)
  • dba6d19ab96 [improve][functions] Allow customizing Kubernetes service domain suffix in Function Worker (#25872)
  • a7a2b0f39a1 [improve][misc] Upgrade vert.x to 4.5.28 (#25924)
  • fce0f057184 [fix][test] Stabilize testSecondaryIsolationGroupsBookiesNegative() test (#25900)
  • 3ee1756953b [improve][offload] Coalesce automatic offload triggers to reduce retry loops and ledger scans (#25793)
  • 6eb8aa44729 [fix][client] Prevent duplicate ServiceUrlProvider initialization (#25899)
  • 7969581f9a4 [fix][proxy] Avoid intermittent 502 when admin proxy follows a broker redirect for a request with a body (#25919)
  • 4a6604db47f [improve][proxy][branch-4.0] Restore AdminProxyHandler changes which were accidentially reverted in Jetty 12 upgrade
  • 306e8ab92c2 [fix][client] Clean up unacked messages when unsubscribing a topic with ack timeout backoff (#25916)
  • ff5399ad00e [fix][sec] Upgrade Netty to 4.1.135.Final to address several CVEs (#25918)
  • d748c44b896 [improve][fn] make built-in functions reload incremental (#25868)
  • 53b6b2fd9fe [fix][test] Fix flaky SameAuthParamsLookupAutoClusterFailoverTest.testAutoClusterFailover() test (#25892)
  • 481723402be [fix][meta] Fix ZooKeeper session reconnect race condition in PulsarZooKeeperClient.clientCreator (#25910)
  • 31fb3ee3b4b [fix][meta] Fix PulsarZooKeeperClient async addWatch callback retry behavior (#25913)
  • 9657bb132e1 [improve][broker] PIP-380: Support-setting-up-specific-namespaces-to-skipping-the-load-shedding (#23549)
  • 8174ed64f7b [fix][test] Fix flaky testMsgDropStat in NonPersistentTopicTest (#25426)
  • 924dd588161 [fix][test][branch-4.0] Fix PulsarFunctionTlsTest
  • f008ce1f177 [fix][test] Fix flaky MessagePublishBufferThrottleTest.testBlockByPublishRateLimiting (#25365)
  • a310c2124a6 [fix][test][branch-4.0] Fix PersistentMessageExpiryMonitorTest
  • f7d353196be [fix][client] Reset higher-index states on recovery in SameAuthParamsLookupAutoClusterFailover (#25826)
  • 73fbdb9e0b8 [fix][client] Fix stale Healthy state in SameAuthParamsLookupAutoClusterFailover causing flaky test (#25388)
  • 87a2b908e14 [fix][broker] Fix stuck chunks in SharedConsumerAssignor permit tracking (#25620)
  • ccac7ac90cb [fix][broker] Fix precision loss in DataSketchesSummaryLogger by replacing LongAdder with DoubleAdder for sum accumulation (#25594)
  • 49a350c8a6b [improve][client] Best-effort retry for individual/batch-index acks on send failure when ackReceiptEnabled=false (#25525)
  • a25236ad4ab [fix][broker] Fix non-batched null-value messages not removed during topic compaction (#25817)
  • 69b316f4522 [fix][bk] Fix NPE in IsolatedBookieEnsemblePlacementPolicy when policy class does not match (#25825)
  • 60b486fde45 [fix][broker] Fix PersistentMessageExpiryMonitor findEntryComplete() method may lose mark-delete properties in race condition (#25803)
  • fa952a8b625 Return 400 for invalid reader messageId query parameter (#25865)
  • 67693921696 [fix][broker] Fix compaction cursor reset may lose mark-delete properties (#25862)
  • 842b91aa3d4 [fix][test] Fix flaky PulsarFunctionTlsTest.testFunctionsCreation() test (#25889)
  • 22f94f2c505 [fix][test] Fix flaky ProducerCleanupTest timer cleanup (#25864)
  • 997ce47a55b [fix][fn] Fix Go function runtime to continue after user exceptions and add neg-ack tests (#25867)
  • 4f5d2cdff0a [improve][misc] Upgrade Netty to 4.1.134 (#25870)
  • 85864615957 [fix][sec] Upgrade commons-configuration2 to 2.15.0 to address CVE-2026-45205 (#25844)
  • 1ac3099d342 [fix][client] Fix failed to close consumer because of the error: param memorySize is a negative value (#25805)
  • 20554c2c891 [fix][client]Fix checkstyle issue of ConsumerBase.java
  • d145525778e [improve][client] In cases where there is a risk of message loss, adjust the log level to error (#25854)
  • d0d0ed5de7b [improve][build] Remove kotlin-stdlib override; upgrade okhttp3 5.3.2 and okio 3.17.0 (#25855)
  • a9e908b0ad6 [fix][test] Fix flaky ResendRequestTest.testSharedSingleAckedPartitionedTopic() test (#25852)
  • 6e1fdc809fa [fix][test] Add timeout to initial receives in ResendRequestTest.testSharedSingleAckedPartitionedTopic (#25828)
  • 15e13829669 [fix][fn] Fix functions update issue where artifact is provided as a http url (#25840)
  • 4e8e1de17ab [improve][fn] Avoid gRPC timeout when getting status of a dead process runtime (#25819)
  • be4ab8cdcad [fix][broker] Fix ManagedLedgerImpl.advanceCursorsIfNecessary() method may lose non-durable cursor properties in race condition (#25796)
  • 1b08c340396 [fix][sec] Bump org.asynchttpclient:async-http-client from 2.14.5 to 2.15.0 (#25818)
  • c3bf63ddd6f [fix][test] Fix compile error in OffloadPoliciesTest
  • c4de38a93a4 [fix][broker] Use effective offload policies for extra configs (#25781)
  • 19bbc5fdc39 [improve][broker] optimize namespaceBundle validation to fix single-thread 100% CPU during unloading entire namespaces (#25626)
  • 466ae2e898b [improve][broker] Prevent stale replicator pending reads after termination (#25767)
  • ac334edb8ab [refactor][fn] Use Map instead of TreeMap for connector/function API types (#25790)
  • 26ac963e37c [improve][fn] make built-in connector reload incremental (#25773)
  • 0cf74d72cf8 [improve][build] Upgrade org.apache.kerby:kerb-simplekdc from 1.1.1 to 2.1.1 (#25785)
  • 93dc7cb84a8 [fix][broker] Fix PulsarService.closeAsync where Condition.signalAll was called without holding a lock (#25777)
  • 71101dc860e [fix][proxy] Close channel on connection failure (#25770)
  • cf25d72914b [fix][sec][branch-4.0] Upgrade avro to 1.11.5 to address CVE-2025-33042 (#25788)
  • d6ccd8f6d58 [fix][test][branch-4.0] Fix AvroSchemaTest cases that were invalid
  • 28d4137f267 [fix][client] Apply Avro logical type conversions when decoding schema without classloader (#25759)
  • 12d9f3942d5 [fix][broker] Close pending acks cleanup gap in BacklogQuotaManager (#25624)
  • b100b0fc9e3 [fix][broker] Move pending acks cleanup to selected mark-delete callbacks (#25592)
  • 2df3c39f711 [improve][client] Implement tls_client_auth for AuthenticationOAuth2 (#25538)
  • 9797148c3aa [improve][client] Enable configurable preemptive OAuth2 token refresh (#25363)
  • 5d0d80d03b0 [fix][broker] Fix race in pending acks removal in redeliverUnacknowledgedMessages (#25589)
  • 372e6c6c1dd [fix][broker] Wait for orphan schema ledger cleanup before retry (#25579)
  • c5b228c2195 [fix][test] Reduce flakiness in testLoadBalancerServiceUnitTableViewSyncer (#25638)
  • 352f91b4e11 [fix][test] Fix flaky ExtensibleLoadManagerImplTest.testLoadBalancerServiceUnitTableViewSyncer (#25596)
  • 7591c4b5ec0 fix(test): use slf4j warn overload in namespaces test
  • b8b558d8e13 fix(test): avoid Map.of in offload policies test
  • 372a1aac412 Revert "fix(test): avoid Map.of in offload policies test"
  • ec0cf6bc2b1 fix(test): avoid Map.of in offload policies test
  • f587918eb13 [fix][test] Reduce flakiness in testLoadBalancerServiceUnitTableViewSyncer (#25638)
  • e975f77af4a [improve][misc] Upgrade Jetty to 12.1.9 (#25752)
  • c030b975978 [fix][test] Make NamespacesTest.cleanupAfterMethod tolerant of transient infra failures (#25641)
  • 4f1946e8426 [fix][test] Fix flaky testGetExcludedBookiesWithIsolationGroups (#25640)
  • 11716086806 [fix][broker] Decrement unacked counter when removeAllUpTo removes pending acks (#25581)
  • 8f80b7ee0a9 [fix][broker] Clean up orphan ledger on concurrent initial schema creation in BookkeeperSchemaStorage (#25514)
  • 2cc75330b9f [fix][broker] Merge broker offload extra configurations (#25736)
  • c9d033621ff [fix][sec] Upgrade thrift to 0.23.0 to address CVE-2026-43869 (#25744)
  • d303f36dc02 [fix][sec] Upgrade vertx to 4.5.27 to address CVE-2026-6860 (#25745)
  • 4bf7bad824d [fix][broker] Correct two race conditions in the tracker code and logic bug in InMemoryDelayedDeliveryTracker that failed with NoSuchElementException (#25681)
  • 06c71309488 [fix][broker] Skip backlog-quota eviction on fenced/closing topics (#25684)
  • 6e1666f1818 [fix][sec] Upgrade vert.x to 4.5.25 to address CVE-2026-6860 (#25737)
  • 68f4c8c4259 [fix][client] Make ClientBuilder serializable (#25730) (#25740)
  • 9dbcf46d1fa [fix][client]Broker-side producer handle leak if closes a producer which state is regitering schema (#25725)
  • f9a205291d9 [fix][broker][fix][broker]Replication stats is empty when the cluster is the target cluster of a one-way replication (#25583)
  • 7b11573becb [fix][broker]Replication is stuck because failed to read entries (#25625)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.9 pulsar-cassandra-admin-2.3.9-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.2 pulsar-jms-admin-9.0.2-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.2 pulsar-jms-9.0.2-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.6 pulsar-protocol-handler-kafka-4.0.3.6.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.4 starlight-rabbitmq-4.0.0.4.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.4 starlight-rabbitmq-4.0.0.4.nar
kafka Kafka Proxy Extension 4.0.3.6 pulsar-kafka-proxy-4.0.3.6.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.17 cassandra-enhanced-pulsar-sink-1.6.17-nar.nar
cloud-storage Writes data into cloud storage 3.2.9 pulsar-io-cloud-storage-3.2.9.nar
data-generator Test data generator source 4.0.11.0 pulsar-io-data-generator-4.0.11.0.nar
elastic_search Writes data into Elastic Search 4.0.11.0 pulsar-io-elastic-search-4.0.11.0.nar
http Writes data to an HTTP server (Webhook) 4.0.11.0 pulsar-io-http-4.0.11.0.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.11.0 pulsar-io-jdbc-clickhouse-4.0.11.0.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.11.0 pulsar-io-jdbc-mariadb-4.0.11.0.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.11.0 pulsar-io-jdbc-openmldb-4.0.11.0.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.11.0 pulsar-io-jdbc-postgres-4.0.11.0.nar
jdbc-sqlite JDBC sink for SQLite 4.0.11.0 pulsar-io-jdbc-sqlite-4.0.11.0.nar
kafka Kafka source and sink connector 4.0.11.0 pulsar-io-kafka-4.0.11.0.nar
kinesis Kinesis connectors 4.0.11.0 pulsar-io-kinesis-4.0.11.0.nar
lakehouse Lakehouse connectors 3.3.5.7 pulsar-io-lakehouse-3.3.5.7-cloud.nar
snowflake Snowflake Connector 0.2.6 pulsar-snowflake-connector-0.2.6.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.9 pulsar-cassandra-source-2.3.9.nar
data-generator Test data generator source 4.0.11.0 pulsar-io-data-generator-4.0.11.0.nar
debezium-mongodb Debezium MongoDb Source 4.0.11.0 pulsar-io-debezium-mongodb-4.0.11.0.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.11.0 pulsar-io-debezium-mssql-4.0.11.0.nar
debezium-mysql Debezium MySql Source 4.0.11.0 pulsar-io-debezium-mysql-4.0.11.0.nar
debezium-oracle Debezium Oracle Source 4.0.11.0 pulsar-io-debezium-oracle-4.0.11.0.nar
debezium-postgres Debezium Postgres Source 4.0.11.0 pulsar-io-debezium-postgres-4.0.11.0.nar
kafka Kafka source and sink connector 4.0.11.0 pulsar-io-kafka-4.0.11.0.nar
kinesis Kinesis connectors 4.0.11.0 pulsar-io-kinesis-4.0.11.0.nar
lakehouse Lakehouse connectors 3.3.5.7 pulsar-io-lakehouse-3.3.5.7-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.5 pulsar-ai-tools-3.2.5.nar
transforms Transformation function 3.2.5 pulsar-transformations-3.2.5.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0.7 9

This is a maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • e9202633344 [improve][misc] Restore bookkeeper config changes by moving PrometheusMetricsProvider under a different package (#707)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.8 pulsar-cassandra-admin-2.3.8-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.1 pulsar-jms-admin-9.0.1-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.1 pulsar-jms-9.0.1-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.5 pulsar-protocol-handler-kafka-4.0.3.5.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.3 starlight-rabbitmq-4.0.0.3.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.3 starlight-rabbitmq-4.0.0.3.nar
kafka Kafka Proxy Extension 4.0.3.5 pulsar-kafka-proxy-4.0.3.5.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.16 cassandra-enhanced-pulsar-sink-1.6.16-nar.nar
cloud-storage Writes data into cloud storage 3.2.8 pulsar-io-cloud-storage-3.2.8.nar
data-generator Test data generator source 4.0.7.9 pulsar-io-data-generator-4.0.7.9.nar
elastic_search Writes data into Elastic Search 4.0.7.9 pulsar-io-elastic-search-4.0.7.9.nar
http Writes data to an HTTP server (Webhook) 4.0.7.9 pulsar-io-http-4.0.7.9.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.9 pulsar-io-jdbc-clickhouse-4.0.7.9.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.9 pulsar-io-jdbc-mariadb-4.0.7.9.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.9 pulsar-io-jdbc-openmldb-4.0.7.9.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.9 pulsar-io-jdbc-postgres-4.0.7.9.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.9 pulsar-io-jdbc-sqlite-4.0.7.9.nar
kafka Kafka source and sink connector 4.0.7.9 pulsar-io-kafka-4.0.7.9.nar
kinesis Kinesis connectors 4.0.7.9 pulsar-io-kinesis-4.0.7.9.nar
lakehouse Lakehouse connectors 3.3.5.6 pulsar-io-lakehouse-3.3.5.6-cloud.nar
snowflake Snowflake Connector 0.2.5 pulsar-snowflake-connector-0.2.5.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.8 pulsar-cassandra-source-2.3.8.nar
data-generator Test data generator source 4.0.7.9 pulsar-io-data-generator-4.0.7.9.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.9 pulsar-io-debezium-mongodb-4.0.7.9.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.9 pulsar-io-debezium-mssql-4.0.7.9.nar
debezium-mysql Debezium MySql Source 4.0.7.9 pulsar-io-debezium-mysql-4.0.7.9.nar
debezium-oracle Debezium Oracle Source 4.0.7.9 pulsar-io-debezium-oracle-4.0.7.9.nar
debezium-postgres Debezium Postgres Source 4.0.7.9 pulsar-io-debezium-postgres-4.0.7.9.nar
kafka Kafka source and sink connector 4.0.7.9 pulsar-io-kafka-4.0.7.9.nar
kinesis Kinesis connectors 4.0.7.9 pulsar-io-kinesis-4.0.7.9.nar
lakehouse Lakehouse connectors 3.3.5.6 pulsar-io-lakehouse-3.3.5.6-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.4 pulsar-ai-tools-3.2.4.nar
transforms Transformation function 3.2.4 pulsar-transformations-3.2.4.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0.7 7

This is a maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • 068221b21a3 [fix][test] Stabilize FunctionAssignmentTailerTest.testErrorNotifier by synchronizing mock stubbing with CountDownLatch (#24875)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.7 pulsar-cassandra-admin-2.3.7-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.0 pulsar-jms-admin-9.0.0-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.0 pulsar-jms-9.0.0-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.4 pulsar-protocol-handler-kafka-4.0.3.4.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.4 pulsar-kafka-proxy-4.0.3.4.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.15 cassandra-enhanced-pulsar-sink-1.6.15-nar.nar
cloud-storage Writes data into cloud storage 3.2.7 pulsar-io-cloud-storage-3.2.7.nar
data-generator Test data generator source 4.0.7.7 pulsar-io-data-generator-4.0.7.7.nar
elastic_search Writes data into Elastic Search 4.0.7.7 pulsar-io-elastic-search-4.0.7.7.nar
http Writes data to an HTTP server (Webhook) 4.0.7.7 pulsar-io-http-4.0.7.7.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.7 pulsar-io-jdbc-clickhouse-4.0.7.7.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.7 pulsar-io-jdbc-mariadb-4.0.7.7.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.7 pulsar-io-jdbc-openmldb-4.0.7.7.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.7 pulsar-io-jdbc-postgres-4.0.7.7.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.7 pulsar-io-jdbc-sqlite-4.0.7.7.nar
kafka Kafka source and sink connector 4.0.7.7 pulsar-io-kafka-4.0.7.7.nar
kinesis Kinesis connectors 4.0.7.7 pulsar-io-kinesis-4.0.7.7.nar
lakehouse Lakehouse connectors 3.3.5.5 pulsar-io-lakehouse-3.3.5.5-cloud.nar
snowflake Snowflake Connector 0.2.4 pulsar-snowflake-connector-0.2.4.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.7 pulsar-cassandra-source-2.3.7.nar
data-generator Test data generator source 4.0.7.7 pulsar-io-data-generator-4.0.7.7.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.7 pulsar-io-debezium-mongodb-4.0.7.7.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.7 pulsar-io-debezium-mssql-4.0.7.7.nar
debezium-mysql Debezium MySql Source 4.0.7.7 pulsar-io-debezium-mysql-4.0.7.7.nar
debezium-oracle Debezium Oracle Source 4.0.7.7 pulsar-io-debezium-oracle-4.0.7.7.nar
debezium-postgres Debezium Postgres Source 4.0.7.7 pulsar-io-debezium-postgres-4.0.7.7.nar
kafka Kafka source and sink connector 4.0.7.7 pulsar-io-kafka-4.0.7.7.nar
kinesis Kinesis connectors 4.0.7.7 pulsar-io-kinesis-4.0.7.7.nar
lakehouse Lakehouse connectors 3.3.5.5 pulsar-io-lakehouse-3.3.5.5-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.3 pulsar-ai-tools-3.2.3.nar
transforms Transformation function 3.2.3 pulsar-transformations-3.2.3.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0.7 6

This is a maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • 871bdbeac51 [improve][io] Add backpressure to kafka-connect-adapter when flush stalled or batchSize reached (#664)
  • 1e025702492 [fix][broker]Producer with AUTO_PRODUCE schema failed to reconnect, which caused by schema incompatible (#25437)
  • 471a958fc2a [improve][broker]Reduce the lock range of SimpleCache to enhance performance (#25293)
  • 9057712bf7a [fix][broker] Fix IllegalArgumentException in BucketDelayedDeliveryTracker.addMessage (#25371)
  • c593e8a199b [fix][broker][branch-4.0] Fix compilation errors after cherry-picking #25312
  • 39a5448dc35 [fix][broker][branch-4.0] Fix compilation errors after cherry-picking #25312
  • 1602da716d2 [fix][broker]system topic was created with different partitions acrossing clusters after enabled namespace-level replication (#25312)
  • b23e96ee93a [fix][broker] Handle missing replicator during snapshot request processing (#25266)
  • d1e78d3509e [fix][io][kca] kafka headers silently dropped (#25325)
  • 550ee03f426 [fix][client] Fail messages immediately in ProducerImpl when in terminal state (#25317)
  • 1917aa6e6e9 [fix] Fix flaky OneWayReplicatorTest.testTopicPoliciesReplicationRule (#25316)
  • 94f68ac80a1 [fix][test] Fix flaky PulsarDebeziumOracleSourceTest (#25314)
  • 1fb0cee45d4 [fix][broker] Fix concurrency bug in BucketDelayedDeliveryTracker (#25346)
  • 1e7c798a0fd [improve][misc] Fixing CVE's for 4.x branch (#625)
  • d14199604f9 [fix][ci] Disable trivy-action (#25373)
  • 8d61f9ec248 added check for collapsePartitionedTopic for sending acknowledgments as well and added integration tests for the same

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.7 pulsar-cassandra-admin-2.3.7-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.0 pulsar-jms-admin-9.0.0-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.0 pulsar-jms-9.0.0-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.4 pulsar-protocol-handler-kafka-4.0.3.4.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.4 pulsar-kafka-proxy-4.0.3.4.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.15 cassandra-enhanced-pulsar-sink-1.6.15-nar.nar
cloud-storage Writes data into cloud storage 3.2.7 pulsar-io-cloud-storage-3.2.7.nar
data-generator Test data generator source 4.0.7.6 pulsar-io-data-generator-4.0.7.6.nar
elastic_search Writes data into Elastic Search 4.0.7.6 pulsar-io-elastic-search-4.0.7.6.nar
http Writes data to an HTTP server (Webhook) 4.0.7.6 pulsar-io-http-4.0.7.6.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.6 pulsar-io-jdbc-clickhouse-4.0.7.6.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.6 pulsar-io-jdbc-mariadb-4.0.7.6.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.6 pulsar-io-jdbc-openmldb-4.0.7.6.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.6 pulsar-io-jdbc-postgres-4.0.7.6.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.6 pulsar-io-jdbc-sqlite-4.0.7.6.nar
kafka Kafka source and sink connector 4.0.7.6 pulsar-io-kafka-4.0.7.6.nar
kinesis Kinesis connectors 4.0.7.6 pulsar-io-kinesis-4.0.7.6.nar
lakehouse Lakehouse connectors 3.3.5.5 pulsar-io-lakehouse-3.3.5.5-cloud.nar
snowflake Snowflake Connector 0.2.4 pulsar-snowflake-connector-0.2.4.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.7 pulsar-cassandra-source-2.3.7.nar
data-generator Test data generator source 4.0.7.6 pulsar-io-data-generator-4.0.7.6.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.6 pulsar-io-debezium-mongodb-4.0.7.6.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.6 pulsar-io-debezium-mssql-4.0.7.6.nar
debezium-mysql Debezium MySql Source 4.0.7.6 pulsar-io-debezium-mysql-4.0.7.6.nar
debezium-oracle Debezium Oracle Source 4.0.7.6 pulsar-io-debezium-oracle-4.0.7.6.nar
debezium-postgres Debezium Postgres Source 4.0.7.6 pulsar-io-debezium-postgres-4.0.7.6.nar
kafka Kafka source and sink connector 4.0.7.6 pulsar-io-kafka-4.0.7.6.nar
kinesis Kinesis connectors 4.0.7.6 pulsar-io-kinesis-4.0.7.6.nar
lakehouse Lakehouse connectors 3.3.5.5 pulsar-io-lakehouse-3.3.5.5-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.3 pulsar-ai-tools-3.2.3.nar
transforms Transformation function 3.2.3 pulsar-transformations-3.2.3.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0.7 4

This is a maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.6 pulsar-cassandra-admin-2.3.6-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.0 pulsar-jms-admin-9.0.0-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.0 pulsar-jms-9.0.0-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.4 pulsar-protocol-handler-kafka-4.0.3.4.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.4 pulsar-kafka-proxy-4.0.3.4.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.15 cassandra-enhanced-pulsar-sink-1.6.15-nar.nar
cloud-storage Writes data into cloud storage 3.2.6 pulsar-io-cloud-storage-3.2.6.nar
data-generator Test data generator source 4.0.7.4 pulsar-io-data-generator-4.0.7.4.nar
elastic_search Writes data into Elastic Search 4.0.7.4 pulsar-io-elastic-search-4.0.7.4.nar
http Writes data to an HTTP server (Webhook) 4.0.7.4 pulsar-io-http-4.0.7.4.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.4 pulsar-io-jdbc-clickhouse-4.0.7.4.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.4 pulsar-io-jdbc-mariadb-4.0.7.4.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.4 pulsar-io-jdbc-openmldb-4.0.7.4.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.4 pulsar-io-jdbc-postgres-4.0.7.4.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.4 pulsar-io-jdbc-sqlite-4.0.7.4.nar
kafka Kafka source and sink connector 4.0.7.4 pulsar-io-kafka-4.0.7.4.nar
kinesis Kinesis connectors 4.0.7.4 pulsar-io-kinesis-4.0.7.4.nar
lakehouse Lakehouse connectors 3.3.5.4 pulsar-io-lakehouse-3.3.5.4-cloud.nar
snowflake Snowflake Connector 0.2.3 pulsar-snowflake-connector-0.2.3.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.6 pulsar-cassandra-source-2.3.6.nar
data-generator Test data generator source 4.0.7.4 pulsar-io-data-generator-4.0.7.4.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.4 pulsar-io-debezium-mongodb-4.0.7.4.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.4 pulsar-io-debezium-mssql-4.0.7.4.nar
debezium-mysql Debezium MySql Source 4.0.7.4 pulsar-io-debezium-mysql-4.0.7.4.nar
debezium-oracle Debezium Oracle Source 4.0.7.4 pulsar-io-debezium-oracle-4.0.7.4.nar
debezium-postgres Debezium Postgres Source 4.0.7.4 pulsar-io-debezium-postgres-4.0.7.4.nar
kafka Kafka source and sink connector 4.0.7.4 pulsar-io-kafka-4.0.7.4.nar
kinesis Kinesis connectors 4.0.7.4 pulsar-io-kinesis-4.0.7.4.nar
lakehouse Lakehouse connectors 3.3.5.4 pulsar-io-lakehouse-3.3.5.4-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.3 pulsar-ai-tools-3.2.3.nar
transforms Transformation function 3.2.3 pulsar-transformations-3.2.3.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0.7 3

This is a maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • 82a2dcea9d7 fix code-style issue
  • 3cd78cb3c44 reverted mismatch commits changes in ProxyConnection.java
  • 1ec194e2f55 Revert "updated hardcoded newLookupProxyHandler in ProxyService for failing URLRegexLookupProxyHandlerTest"
  • ae2c82765e3 reverted lincense for opentelemetry upgrade changes
  • 250900811f0 Revert "[improve][monitor] Upgrade OpenTelemetry to 1.56.0, Otel instrumentation to 2.21.0 and Otel semconv to 1.37.0 (#24994)"
  • 2d15d0d2b05 updated hardcoded newLookupProxyHandler in ProxyService for failing URLRegexLookupProxyHandlerTest
  • 20d8c7d57a2 Revert "fix pulsar-proxy unit test case failure"
  • d3c51978500 Revert "fix safe delete URLRegexLookupProxyHandler which is not used"
  • f3d44c501c8 fix safe delete URLRegexLookupProxyHandler which is not used
  • 24851f6774d fix pulsar-proxy unit test case failure
  • 0362453f49a [fix][meta] Metadata cache refresh might not take effect (#25246)
  • a91d35da135 [fix][test] Fix ResourceQuotaCalculatorImplTest#testNeedToReportLocalUsage (#25247)
  • 44f172f3539 [fix][test] fix testBatchMetadataStoreMetrics. (#25241)
  • 2a21d9287ea [improve] Upgrade Netty to 4.1.131.Final (#25232)
  • 36943f60f18 Reapply "[improve][meta] PIP-453: Improve the metadata store threading model (#25187)"
  • fc6121597c6 uncomment distribution management in pom
  • 3080480876a [fix][broker] Fix transactionMetadataFuture completeExceptionally with null value (#25231)
  • 4fff903a53e [fix][client] Send all chunkMessageIds to broker for redelivery (#25229)
  • ead294214ff [improve][broker] Give the detail error msg when authenticate failed with AuthenticationException (#25221)
  • 017245fc1c4 [fix][test] Fix Mockito stubbing race in TopicListServiceTest (#25227)
  • b2621a6ae44 [fix][broker] Fix incomplete futures in topic property update/delete methods (#25228)
  • 9e8d57d136a [improve][broker] Add idle timeout support for http (#25224)
  • e4d6eca6e47 Revert "[improve][broker] Add strictAuthMethod to require explicit authentication method (#25185)"
  • 0a0b4d47a7d [improve][client] Make authorization server metadata path configurable in AuthenticationOAuth2 (#25052)
  • 87d07a0af61 [feat][client] oauth2 trustcerts file and timeouts (#24944)
  • 5d05083386e [improve][broker] Add strictAuthMethod to require explicit authentication method (#25185)
  • 7f66cb3cc49 [fix][broker] Fix httpProxyTimeout config (#25223)
  • 2e93fb69464 [feat][io] implement pip-297 for jdbc sinks (#25195)
  • eb921d7d3cc fix for complilation error
  • 1236fd9642f [fix][broker] Prevent missed topic changes in topic watchers and schedule periodic refresh with patternAutoDiscoveryPeriod interval (#25188)
  • 4ab6e34c71f [fix][client] Fix producer synchronous retry handling in failPendingMessages method (#25207)
  • 7a5a543822d [fix][broker]Fix ledgerHandle failed to read by using new BK API (#25199)
  • 8df9c501630 [fix][broker] Fix ManagedCursorImpl.asyncDelete() method may lose previous async mark delete properties in race condition (#25165)
  • d8fb388013f [fix][test]Fix flaky ExtensibleLoadManagerImplTest_testGetMetrics (#25216)
  • c7f4ca1a916 fix license issues
  • ae393e62e52 [improve][proxy] Add regression tests for package upload with 'Expect: 100-continue' (#25211)
  • d6d5c6b141f [improve][monitor] Upgrade OpenTelemetry to 1.56.0, Otel instrumentation to 2.21.0 and Otel semconv to 1.37.0 (#24994)
  • a7f36a6aee2 [fix][client] Fix race condition between isDuplicate() and flushAsync() method in PersistentAcknowledgmentsGroupingTracker due to incorrect use Netty Recycler (#25208)
  • 629fbf6aace [fix] [test] Upgrade docker-java to 3.7.0 (#25209)
  • 0e9e42935c2 fix checkstyle failure and license issues
  • 0b7a2564b2b [fix][sec] Exclude org.lz4:lz4-java and standardize on at.yawk.lz4-java to remediate CVE-2025-12183 and CVE-2025-66566 (#25198)
  • b155917c76e [fix][misc] Allow JWT tokens in OpenID auth without nbf claim (#25197)
  • 0d92b6efc5b [improve][client]Reduce unnecessary getPartitionedTopicMetadata requests when using retry and DLQ topics. (#25172)
  • 1397fda7f50 [improve][pip] PIP-453: Improve the metadata store threading model (#25173)
  • af1d4704e91 [fix][sec] Bump org.apache.solr:solr-core from 9.8.0 to 9.10.1 in /pulsar-io/solr (#25175)
  • cc9cf8248a6 [fix][client] ControlledClusterFailover avoid unnecessary reconnection. (#25178)
  • 6b35a5eb216 [fix][proxy] Close client connection immediately when credentials expire and forwardAuthorizationCredentials is disabled (#25179)
  • 7c2440019f6 [improve][misc] Upgrade snappy version to 1.1.10.8 (#25182)
  • 50fe75f286d [fix][test] Bump org.assertj:assertj-core from 3.27.5 to 3.27.7 (#25186)
  • b77794e5c24 [fix][ml] Fix NoSuchElementException in EntryCountEstimator caused by a race condition (#25177)
  • 2fa2e899b3f fix license and pom file
  • 8502a8575e1 [improve][broker] Upgrade bookkeeper to 4.17.3 (#25166)
  • ba8d558123f [improve][broker] Ensure metadata session state visibility and improve Unstable observability for ServiceUnitStateChannelImpl (#25132)
  • d30239a4ca4 Revert "[improve][misc]LS: 1408 cherry pick commit from pulsar branch 4 0 to …" (#595)
  • a54cf70e4f2 [improve][misc]LS: 1408 cherry pick commit from pulsar branch 4 0 to datastax 4 0 ds 16 feb (#589)
  • 5ddc34f6dec Reverted jersey version upgrade in license
  • 330195733a7 Removed jersey version upgrade
  • 0812a00f3c7 Updated license
  • 62472702ef7 Upgraded jersey version
  • c55c83fe9df licence check fixed and debezium-mysql-connector vulnerability fixed
  • 3fa1898f5c8 Fixed vulnerabilities
  • 918508c2851 [improve][broker] PIP-442: Add memory limits for topic list watcher (part 2) (#25070)
  • 0357ffb340e [fix][fn] Fix graceful Pulsar Function shutdown so that consumers and producers are closed (#25157)
  • 7e799db2b23 [fix][broker] Fence reset cursor by timestamp to avoid concurrent timestamp-based position lookups (#25151)
  • 4e46e5d74b6 [fix][sec] Upgrade vertx to address CVE-2026-1002 (#25152)
  • 496cbecacc0 [fix][ml] Retry offload reads when OffloadReadHandleClosedException is encountered (#25148)
  • d49372ed025 [fix][admin] Fix offload policy incompatible issue. (#25149)
  • 71e1f09a34c [fix][proxy] Fix memory leaks in ParserProxyHandler (#25142)
  • 3d38269334c [fix][fn] complete flushAsync before closeAsync in ProducerCache and wait for completion in closing the cache (#25140)
  • 08a82083bab [fix][broker] Avoid split non-existent bundle (#25031)
  • e730ca08d50 [fix][broker] Fix regex matching of namespace name which might contain a regex char (#25136)
  • d85f9e928e4 [fix][broker] Fix markDeletedPosition race condition in ManagedLedgerImpl.maybeUpdateCursorBeforeTrimmingConsumedLedger() method (#25110)
  • 9c474644d21 [fix][test] Wait for txn.abort() to complete to avoid AdminApiTransactionTest.testAnalyzeSubscriptionBacklogWithTransactionMarker() flaky test (#25125)
  • d6190b21d19 [improve][admin] Add counter for marker messages in PersistentTopics.analyzeSubscriptionBacklog() rest api (#25091)
  • 7f76277d0dd [fix][broker]Topic deleting failed after removed local cluster from namespace policies (#25114)
  • 1c95c910780 [fix][admin] Fix asyncGetRequest to handle 204 (#25124)
  • 51548186d66 [fix][broker] Fix compaction horizon might be reset to an old position when phase two is interrupted (#25119)
  • 12fc9b94316 [improve][broker] Fix thread safety issue in ManagedCursorImpl.removeProperty (#25104)
  • c0097e03c7d [fix][broker] Fix MultiRolesTokenAuthorizationProvider error when subscription prefix doesn't match. (#25121)
  • 52c3bbfb3ba [fix][ml] Fix cursor backlog size to account for individual acks (#25089)
  • fc46a767fce [fix][broker] Fix chunked message loss when no consumers are available (#25077)
  • 605e64492d7 [improve][broker] Change the log level from error to info when throwing NotAllowedException (#25130)
  • 4b25453e054 [improve][broker] Enhance logging for adding schema failures in ServerCnx (#25048)
  • 3a7cc86b0f4 [fix][test] Fix ManagedCursorTest and NonDurableCursorTest flaky tests (#25101)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.6 pulsar-cassandra-admin-2.3.6-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 9.0.0 pulsar-jms-admin-9.0.0-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 9.0.0 pulsar-jms-9.0.0-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.4 pulsar-protocol-handler-kafka-4.0.3.4.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.4 pulsar-kafka-proxy-4.0.3.4.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.15 cassandra-enhanced-pulsar-sink-1.6.15-nar.nar
cloud-storage Writes data into cloud storage 3.2.6 pulsar-io-cloud-storage-3.2.6.nar
data-generator Test data generator source 4.0.7.3 pulsar-io-data-generator-4.0.7.3.nar
elastic_search Writes data into Elastic Search 4.0.7.3 pulsar-io-elastic-search-4.0.7.3.nar
http Writes data to an HTTP server (Webhook) 4.0.7.3 pulsar-io-http-4.0.7.3.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.3 pulsar-io-jdbc-clickhouse-4.0.7.3.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.3 pulsar-io-jdbc-mariadb-4.0.7.3.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.3 pulsar-io-jdbc-openmldb-4.0.7.3.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.3 pulsar-io-jdbc-postgres-4.0.7.3.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.3 pulsar-io-jdbc-sqlite-4.0.7.3.nar
kafka Kafka source and sink connector 4.0.7.3 pulsar-io-kafka-4.0.7.3.nar
kinesis Kinesis connectors 4.0.7.3 pulsar-io-kinesis-4.0.7.3.nar
lakehouse Lakehouse connectors 3.3.5.4 pulsar-io-lakehouse-3.3.5.4-cloud.nar
snowflake Snowflake Connector 0.2.3 pulsar-snowflake-connector-0.2.3.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.6 pulsar-cassandra-source-2.3.6.nar
data-generator Test data generator source 4.0.7.3 pulsar-io-data-generator-4.0.7.3.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.3 pulsar-io-debezium-mongodb-4.0.7.3.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.3 pulsar-io-debezium-mssql-4.0.7.3.nar
debezium-mysql Debezium MySql Source 4.0.7.3 pulsar-io-debezium-mysql-4.0.7.3.nar
debezium-oracle Debezium Oracle Source 4.0.7.3 pulsar-io-debezium-oracle-4.0.7.3.nar
debezium-postgres Debezium Postgres Source 4.0.7.3 pulsar-io-debezium-postgres-4.0.7.3.nar
kafka Kafka source and sink connector 4.0.7.3 pulsar-io-kafka-4.0.7.3.nar
kinesis Kinesis connectors 4.0.7.3 pulsar-io-kinesis-4.0.7.3.nar
lakehouse Lakehouse connectors 3.3.5.4 pulsar-io-lakehouse-3.3.5.4-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.3 pulsar-ai-tools-3.2.3.nar
transforms Transformation function 3.2.3 pulsar-transformations-3.2.3.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0 7.2

This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

  • 758fdae fix licence for org.apache.commons-commons-collections4
  • 88d536a [fix][client] Producer stuck or geo-replication stuck due to wrong value of message.numMessagesInBatch (#25106)
  • c4d3018 [fix][broker] pulsar_ml_reads_inflight_bytes and pulsar_ml_reads_available_inflight_bytes are 0 at the same time (#25105)
  • eeab23e [fix][sec] Upgrade log4j to 2.25.3 to address CVE-2025-68161 (#25102)
  • 8c7b7f0 [fix][sec] Upgrade jose4j to 0.9.6 to address CVE-2024-29371 (#25095)
  • 294cf65 [fix][broker] Fix cursor position persistence in ledger trimming (#25087)
  • adcb209 [improve][io] Replace Qpid in tests with RabbitMQ in Testcontainers and upgrade RabbitMQ client version (#25085)
  • a1fad07 [fix][build] Activate jdk21 and jdk24 profiles on Java 25 (#25084)
  • ef75b40 [fix][sec] Upgrade Netty to 4.1.130.Final (#25078)
  • f62ab36 [fix][broker] Infinitely failed to delete topic if the first time failed and enabled transaction (#25073)
  • 2488d31 [fix][broker] Fix incorrect backlog if use multiple acknowledge types on the same subscription (#25047)
  • b4572db [fix][broker] PIP-442: Fix race condition in async semaphore permit updates that causes memory limits to become ineffective (#25066)
  • c339936 [fix][broker] fix prepareInitPoliciesCacheAsync in SystemTopicBasedTopicPoliciesService (#24980)
  • b616398 [improve][broker] Optimize Reader creation in TopicPoliciesService (#24658)
  • d618367 [improve][broker] Use atomic counter for ongoing transaction count (#25053)
  • 8ceb610 [fix][client] Fix invalid parameter type passed to Map.get in TopicsImpl.getListAsync method (#25069)
  • 6b27381 [improve][broker] Improve replicated subscription snapshot cache so that subscriptions can be replicated when mark delete position update is not frequent (#25044)
  • be235b1 [fix][broker] Force EnsemblePolicies to resolve network location after rackInfoMap is updated due to changes in /ledgers/available znode (#25067)
  • 8fb6b29 [fix][admin] Refactor bookie affinity group sync operations to async in rest api (#25050)
  • 6f040ae [fix][broker] Fix various error-prone detected errors mainly in logging and String.format parameters (#25059)
  • 6b94167 [improve][build] Upgrade errorprone to 2.45.0 version (#25054)
  • c8a45b9 [fix][cli] Fix output of --print-metadata in cli consume (#25056)
  • bc70480 [fix][cli] Fix some pulsar-admin topicPolicies commands exiting before async operations complete (#25051)
  • 807e76f [fix][sec] Bump at.yawk.lz4:lz4-java from 1.9.0 to 1.10.1 in /pulsar-common (#25045)
  • 19d47ae [improve][misc] introduce log4j Console appender ConsoleJson (#25034)
  • d350c03 [fix][test] Replace LZ4FastDecompressor with LZ4SafeDecompressor in test (#25032)
  • 1a9b8c6 [improve][misc] Add log4j-layout-template-json to server distribution (#25027)
  • 79d019f [improve][broker] Add test for getting partitioned topic metadata with PulsarAdmin client (#25026)
  • 5dfee8b [improve][client] Add null checks for MessageAcknowledger methods (#25036)
  • 6ae2d0e [fix][broker] Fix potential NPE in InMemTransactionBuffer.appendBufferToTxn (#25039)
  • 7612bc6 [improve][broker] Fix replicated subscriptions race condition with mark delete update (#16651)
  • c64d794 [fix][broker] Avoid read a entry that entry id is -1 when calling getLastMessagePublishTime (#24579)
  • 50e9199 [fix][broker] Incorrect backlog that is larger than expected (#25037)
  • 322fddb Fix the test for cherry-picking #24825
  • 16773c9 [improve][broker] Cache last publish timestamp for idle topics (#24825)
  • d2dd3e8 Revert "[improve][monitor] Upgrade OpenTelemetry …" (#24994)
  • c2fab3a Fix OneWayReplicatorTestBase missing cmd
  • a86d7e8 [feat] PIP-442: Add memory limits for CommandGetTopicsOfNamespace (#24833)
  • 37cfc86 Upgrade dependencies to resolve vulnerabilities
  • b1dbcd5 [fix][test][branch-4.0] Add missing trueFalse DataProvider
  • 97a64ee Fix OneWayReplicatorSchemaValidationEnforcedTest unit test
  • 805e72c [fix][sec] Eliminate commons-collections dependency (#25024)
  • ec5dca1 [fix][broker] Fix memory leak when using a customized ManagedLedger implementation (#25016)
  • e2e64bc [fix] Upgrade gson to 2.13.2 (#25022)
  • 797b98d [fix][client] Fix thread-safety of AutoProduceBytesSchema (#25014)
  • 172a2b8 [fix][client] Fix AutoProduceBytesSchema.clone() method (#25015)
  • 38186a4 [improve][broker] Remove the warn log that frequently prints (#25018)
  • 42da55c [improve] Eliminate unnecessary duplicate schema lookups (#25011)
  • 1ed2956 [fix][broker] Add schema version in rest produce api (#25004)
  • f28fc91 [improve][client] Test no exception for invalid epoch in message (#25013)
  • c889247 [fix][branch-4.0] Fix checkstyle

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.4 pulsar-cassandra-admin-2.3.4-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.6 pulsar-jms-admin-6.0.6-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.6 pulsar-jms-6.0.6-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.3 pulsar-protocol-handler-kafka-4.0.3.3.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.3 pulsar-kafka-proxy-4.0.3.3.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.14 cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
cloud-storage Writes data into cloud storage 3.2.6 pulsar-io-cloud-storage-3.2.6.nar
data-generator Test data generator source 4.0.7.2 pulsar-io-data-generator-4.0.7.2.nar
elastic_search Writes data into Elastic Search 4.0.7.2 pulsar-io-elastic-search-4.0.7.2.nar
http Writes data to an HTTP server (Webhook) 4.0.7.2 pulsar-io-http-4.0.7.2.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.2 pulsar-io-jdbc-clickhouse-4.0.7.2.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.2 pulsar-io-jdbc-mariadb-4.0.7.2.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.2 pulsar-io-jdbc-openmldb-4.0.7.2.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.2 pulsar-io-jdbc-postgres-4.0.7.2.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.2 pulsar-io-jdbc-sqlite-4.0.7.2.nar
kafka Kafka source and sink connector 4.0.7.2 pulsar-io-kafka-4.0.7.2.nar
kinesis Kinesis connectors 4.0.7.2 pulsar-io-kinesis-4.0.7.2.nar
lakehouse Lakehouse connectors 3.3.5.3 pulsar-io-lakehouse-3.3.5.3-cloud.nar
snowflake Snowflake Connector 0.2.2 pulsar-snowflake-connector-0.2.2.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.4 pulsar-cassandra-source-2.3.4.nar
data-generator Test data generator source 4.0.7.2 pulsar-io-data-generator-4.0.7.2.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.2 pulsar-io-debezium-mongodb-4.0.7.2.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.2 pulsar-io-debezium-mssql-4.0.7.2.nar
debezium-mysql Debezium MySql Source 4.0.7.2 pulsar-io-debezium-mysql-4.0.7.2.nar
debezium-oracle Debezium Oracle Source 4.0.7.2 pulsar-io-debezium-oracle-4.0.7.2.nar
debezium-postgres Debezium Postgres Source 4.0.7.2 pulsar-io-debezium-postgres-4.0.7.2.nar
kafka Kafka source and sink connector 4.0.7.2 pulsar-io-kafka-4.0.7.2.nar
kinesis Kinesis connectors 4.0.7.2 pulsar-io-kinesis-4.0.7.2.nar
lakehouse Lakehouse connectors 3.3.5.3 pulsar-io-lakehouse-3.3.5.3-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.1 pulsar-ai-tools-3.2.1.nar
transforms Transformation function 3.2.1 pulsar-transformations-3.2.1.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0 7.1

This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • d28392d [fix][broker][branch-4.0] Fix failed testFinishTakeSnapshotWhenTopicLoading due to topic future cache conflicts (#24947)
  • 1510ecf [fix][txn] fix concurrent error cause txn stuck in TransactionBufferHandlerImpl#endTxn (#23551)
  • eb17c66 [fix][broker] Avoid recursive update in ConcurrentHashMap during policy cache cleanup (#24939)
  • 354c517 [fix][monitor] Fix the incorrect metrics name (#21981)
  • a97a9dd [improve][broker] Add tests for using absolute FQDN for advertisedAddress and remove extra dot from brokerId (#24787)
  • e6dd5ef [fix][admin] Set local policies overwrites "number of bundles" passed during namespace creation (#24762)
  • 14a6749 [fix][sec] Override nimbus-jose-jwt to remediate CVE-2023-52428 and CVE-2025-53864 (#24937)
  • d03cf00 [fix][broker] Fix bug in PersistentMessageExpiryMonitor which blocked further expirations (#24941)
  • 4fb254d [fix][test] Stabilize testMsgDropStat by reliably triggering non-persistent publisher drop (#24929)
  • 5ca3b8c [fix][sec] Override commons-beanutils and commons-configuration2 to remediate CVEs (#24936)
  • 563e58c [fix][sec] Override kafka-clients in kinesis-kpl-shaded to remediate CVE-2024-31141 and CVE-2025-27817 (#24935)
  • 9e47425 [fix][broker] Fix stack overflow caused by race condition when closing a connection (#24934)
  • 176e07d [fix][broker] ExtensibleLoadManager: handle SessionReestablished and Reconnected events to re-register broker metadata (#24932)
  • fb87033 [fix][broker] Use poll instead remove to avoid NoSuchElementException (#24933)
  • 891aa50 [fix][broker] fix getMaxReadPosition in TransactionBufferDisable should return latest (#24898)
  • 5998856 [improve][broker] Don't log an error when updatePartitionedTopic is called on a non-partitioned topic (#24943)
  • b2ff7e6 [improve][broker] Optimize lookup result warn log (#24942)
  • 91ba207 [fix][client] Fix thread leak in reloadLookUp method which is used by ServiceUrlProvider (#24794)
  • 2cf6dc0 [fix][broker] Run ResourceGroup tasks only when tenants/namespaces registered (#24859)
  • 3eff549 [fix][sec] Upgrade BouncyCastle FIPS to 2.0.10 to remediate CVE-2025-8916 (#24923)
  • 73808c4 [fix][broker] BacklogMessageAge is not reset when cursor mdPosition is on an open ledger (#24915)
  • 0c68377 [fix][broker] Fix wrong behaviour when using namespace.allowed_clusters, such as namespace deletion and namespace policies updating (#24860)
  • 4cfc53b [improve][ci] Move replication tests to new group Broker Group 5 in Pulsar CI (#24917)
  • 7ac7438 [fix][sec] Upgrade Spring to 6.2.12 to remediate CVE-2025-22233 and CVE-2025-41249 (#24903)
  • 10d9820 [improve][misc] Upgrade Netty to 4.1.128.Final (#24911)
  • 29bec39 [fix][test] Fix flaky ReplicatorTest.testResumptionAfterBacklogRelaxed (#24904)
  • c8375e7 [improve][broker] Reduce the broker close time to avoid useless wait for event loop shutdown (#24895)
  • f7c4f95 [fix][broker] Fix totalAvailablePermits not reduced when removing consumer from non-persistent dispatcher (#24885)
  • 5ecdcaa [fix][test]fix flaky SimpleProducerConsumerTest.testReceiveAsyncCompletedWhenClosing (#24858)
  • 16e8ae4 [fix][test] Made ProtobufSchemaTest.testParsingInfoProperty order-independent (#24807)
  • 61c2480 [improve][client]Add null check for Pulsar client clock configuration (#24848)
  • 377133e [fix][test] BacklogQuotaManagerTest.backlogsAgeMetricsNoPreciseWithoutBacklogQuota handle empty /metrics scrape (#24887)
  • ea1e3e4 [improve][broker]Skip to mark delete if the target position of expira… (#24881)
  • 74892dc [fix][broker] Stop to retry to read entries if the replicator has terminated (#24880)
  • cd4cea8 [fix][broker] Flaky-test: TopicTransactionBufferTest.testMessagePublishInOrder (#24826)
  • e5b61fc [fix][test] Stabilize PublishRateLimiterOverconsumingTest by aligning measurement and using adjacent 2-sec averages (#24864)
  • a02310b [fix][test] Fix flaky LookupPropertiesTest.testConcurrentLookupProperties (#24854)
  • ce14580 [fix][sec] Upgrade Jetty to 9.4.58.v20250814 to address CVE-2025-5115 (#24897)
  • 22defed [fix][sec] Bump io.vertx:vertx-web from 4.5.10 to 4.5.22 (#24889)
  • 824019a [fix][test] Stabilize SequenceIdWithErrorTest by fencing after first publish to avoid empty-ledger deletion and send timeout (#24861)
  • 8be9698 [fix][test] Fix flaky SubscriptionSeekTest.testSeekWillNotEncounteredFencedError by counting subscription is fenced only after seek (#24865)
  • 26f5a2c [fix][ml] Fix ledger trimming race causing cursor to point to deleted ledgers (#24855)
  • 97368ed Fix compile issue by cherry-picked #24852
  • 997aea2 [fix]Fixed getChildren('/') on Oxia based provider (#24863)
  • 9c83d13 [fix][ml] Fix getNumberOfEntries may point to deleted ledger (#24852)
  • 6c5c797 [fix][broker] Ensure LoadSheddingTask is scheduled after metadata service is available again (#24838)
  • ed13768 [improve][ci] Upgrade GitHub Actions workflows to use ubuntu-24.04 (#24841)
  • dcccbb9 [fix][client] Fix getPendingQueueSize for PartitionedTopicProducerStatsRecorderImpl: avoid NPE and implement aggregation (#24830)
  • 283b123 [fix] Fix mixed lookup/partition metadata requests causing reliability issues and incorrect responses (#24832)
  • 62350ef [fix][broker] Allow intermittent error from topic policies service when loading topics (#24829)
  • 2dd7a5c [fix][broker] Fix incorrect topic loading latency metric and timeout might not be respected (#24785)
  • e734235 [fix][client] Make auto partitions update work for old brokers without PIP-344 (#24822)
  • 8531eef [improve][broker]Improve NamespaceService log that is printed when cluster was removed (#24801)
  • ac9bb27 [fix][broker] Flaky-test: ExtensibleLoadManagerImplTest.testDisableBroker (#24770)
  • e4c4a35 [improve][broker] Replace isServiceUnitActiveAsync with checkTopicNsOwnership (#24780)
  • cd6d4a5 [improve][ml] Upgrade Oxia client to 0.7.0 (#24824)
  • 88d4253 [fix][build] Remove invalid profile in settings.xml that caused gpg signing to fail (#24812)
  • c3d669e [fix][build] Fix maven deploy with maven-source-plugin 3.3.1 (#24811)
  • 0b53b79 [fix] Update gRPC to 1.75.0 (#24813)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.2 pulsar-cassandra-admin-2.3.2-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.6 pulsar-jms-admin-6.0.6-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.6 pulsar-jms-6.0.6-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.3 pulsar-protocol-handler-kafka-4.0.3.3.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.3 pulsar-kafka-proxy-4.0.3.3.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.14 cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
cloud-storage Writes data into cloud storage 3.2.4 pulsar-io-cloud-storage-3.2.4.nar
data-generator Test data generator source 4.0.7.1 pulsar-io-data-generator-4.0.7.1.nar
elastic_search Writes data into Elastic Search 4.0.7.1 pulsar-io-elastic-search-4.0.7.1.nar
http Writes data to an HTTP server (Webhook) 4.0.7.1 pulsar-io-http-4.0.7.1.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.1 pulsar-io-jdbc-clickhouse-4.0.7.1.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.1 pulsar-io-jdbc-mariadb-4.0.7.1.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.1 pulsar-io-jdbc-openmldb-4.0.7.1.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.1 pulsar-io-jdbc-postgres-4.0.7.1.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.1 pulsar-io-jdbc-sqlite-4.0.7.1.nar
kafka Kafka source and sink connector 4.0.7.1 pulsar-io-kafka-4.0.7.1.nar
kinesis Kinesis connectors 4.0.7.1 pulsar-io-kinesis-4.0.7.1.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
snowflake Snowflake Connector 0.2.1 pulsar-snowflake-connector-0.2.1.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.2 pulsar-cassandra-source-2.3.2.nar
data-generator Test data generator source 4.0.7.1 pulsar-io-data-generator-4.0.7.1.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.1 pulsar-io-debezium-mongodb-4.0.7.1.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.1 pulsar-io-debezium-mssql-4.0.7.1.nar
debezium-mysql Debezium MySql Source 4.0.7.1 pulsar-io-debezium-mysql-4.0.7.1.nar
debezium-oracle Debezium Oracle Source 4.0.7.1 pulsar-io-debezium-oracle-4.0.7.1.nar
debezium-postgres Debezium Postgres Source 4.0.7.1 pulsar-io-debezium-postgres-4.0.7.1.nar
kafka Kafka source and sink connector 4.0.7.1 pulsar-io-kafka-4.0.7.1.nar
kinesis Kinesis connectors 4.0.7.1 pulsar-io-kinesis-4.0.7.1.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.1 pulsar-ai-tools-3.2.1.nar
transforms Transformation function 3.2.1 pulsar-transformations-3.2.1.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0 7.0

This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • 0bb2c25 [improve][misc] Cherrypick Add API endpoint for function-worker for liveness check with configurable flag into 4.x (#530)
  • 7b653a8 Update project.version to 4.0.7.0
  • 239c42b Bump org.apache.zookeeper:zookeeper from 3.9.3 to 3.9.4 (#24779)
  • 3c9b0b0 [improve][broker] Call scheduleAtFixedRateNonConcurrently for scheduled tasks, instead of scheduleAtFixedRate (#24596)
  • e740e41 [fix][test] Flaky-test: BrokerServiceTest.testShutDownWithMaxConcurrentUnload (#24769)
  • 35042f3 [improve][build] Upgrade Mockito, AssertJ and ByteBuddy to fully support JDK25 (#24764)
  • fa8a318 [fix][client] Exclude io.prometheus:simpleclient_caffeine from client-side dependencies (#24761)
  • 1ba2e08 [improve][build] Upgrade Lombok to 1.18.42 to fully support JDK25 (#24763)
  • e3190a8 [improve][broker] If there is a deadlock in the service, the probe should return a failure because the service may be unavailable (#23634)
  • ffd8a0c [fix][broker] First entry will be skipped if opening NonDurableCursor while trimmed ledger is adding first entry. (#24738)
  • cf11b88 [fix][ml] Fix EOFException after enabled topics offloading (#24753)
  • aca4c1c [fix][misc] Fix compareTo contract violation for NamespaceBundleStats, TimeAverageMessageData and ResourceUnitRanking (#24772)
  • 514b6d0 [improve][build] Upgrade SpotBugs to a version that supports JDK25 (#24768)
  • 123ac4d [fix][ci] Fix CI for Java 25 including upgrade of Gradle Develocity Maven extension (#24767)
  • b985640 [improve][broker] Separate offload read and write thread pool (#24025)
  • 11769a9 Remove unbundled jars from license
  • 4514ab1 Upgrade bookkeeper to 4.17.1.0.0.4
  • c3cf5e0 [improve][misc] LS-1356: Upgrade debezium to 3.2.0.Final (#496)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.2 pulsar-cassandra-admin-2.3.2-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.6 pulsar-jms-admin-6.0.6-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.6 pulsar-jms-6.0.6-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.2 pulsar-protocol-handler-kafka-4.0.3.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.2 pulsar-kafka-proxy-4.0.3.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.14 cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
cloud-storage Writes data into cloud storage 3.2.4 pulsar-io-cloud-storage-3.2.4.nar
data-generator Test data generator source 4.0.7.0 pulsar-io-data-generator-4.0.7.0.nar
elastic_search Writes data into Elastic Search 4.0.7.0 pulsar-io-elastic-search-4.0.7.0.nar
http Writes data to an HTTP server (Webhook) 4.0.7.0 pulsar-io-http-4.0.7.0.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.7.0 pulsar-io-jdbc-clickhouse-4.0.7.0.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.7.0 pulsar-io-jdbc-mariadb-4.0.7.0.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.7.0 pulsar-io-jdbc-openmldb-4.0.7.0.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.7.0 pulsar-io-jdbc-postgres-4.0.7.0.nar
jdbc-sqlite JDBC sink for SQLite 4.0.7.0 pulsar-io-jdbc-sqlite-4.0.7.0.nar
kafka Kafka source and sink connector 4.0.7.0 pulsar-io-kafka-4.0.7.0.nar
kinesis Kinesis connectors 4.0.7.0 pulsar-io-kinesis-4.0.7.0.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
snowflake Snowflake Connector 0.2.1 pulsar-snowflake-connector-0.2.1.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.2 pulsar-cassandra-source-2.3.2.nar
data-generator Test data generator source 4.0.7.0 pulsar-io-data-generator-4.0.7.0.nar
debezium-mongodb Debezium MongoDb Source 4.0.7.0 pulsar-io-debezium-mongodb-4.0.7.0.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.7.0 pulsar-io-debezium-mssql-4.0.7.0.nar
debezium-mysql Debezium MySql Source 4.0.7.0 pulsar-io-debezium-mysql-4.0.7.0.nar
debezium-oracle Debezium Oracle Source 4.0.7.0 pulsar-io-debezium-oracle-4.0.7.0.nar
debezium-postgres Debezium Postgres Source 4.0.7.0 pulsar-io-debezium-postgres-4.0.7.0.nar
kafka Kafka source and sink connector 4.0.7.0 pulsar-io-kafka-4.0.7.0.nar
kinesis Kinesis connectors 4.0.7.0 pulsar-io-kinesis-4.0.7.0.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.1 pulsar-ai-tools-3.2.1.nar
transforms Transformation function 3.2.1 pulsar-transformations-3.2.1.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0 3.6

This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.2 pulsar-cassandra-admin-2.3.2-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.6 pulsar-jms-admin-6.0.6-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.6 pulsar-jms-6.0.6-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.2 pulsar-protocol-handler-kafka-4.0.3.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.2 pulsar-kafka-proxy-4.0.3.2.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.14 cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
cloud-storage Writes data into cloud storage 3.2.4 pulsar-io-cloud-storage-3.2.4.nar
data-generator Test data generator source 4.0.3.6 pulsar-io-data-generator-4.0.3.6.nar
elastic_search Writes data into Elastic Search 4.0.3.6 pulsar-io-elastic-search-4.0.3.6.nar
http Writes data to an HTTP server (Webhook) 4.0.3.6 pulsar-io-http-4.0.3.6.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.3.6 pulsar-io-jdbc-clickhouse-4.0.3.6.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.3.6 pulsar-io-jdbc-mariadb-4.0.3.6.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.3.6 pulsar-io-jdbc-openmldb-4.0.3.6.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.3.6 pulsar-io-jdbc-postgres-4.0.3.6.nar
jdbc-sqlite JDBC sink for SQLite 4.0.3.6 pulsar-io-jdbc-sqlite-4.0.3.6.nar
kafka Kafka source and sink connector 4.0.3.6 pulsar-io-kafka-4.0.3.6.nar
kinesis Kinesis connectors 4.0.3.6 pulsar-io-kinesis-4.0.3.6.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
snowflake Snowflake Connector 0.2.1 pulsar-snowflake-connector-0.2.1.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.2 pulsar-cassandra-source-2.3.2.nar
data-generator Test data generator source 4.0.3.6 pulsar-io-data-generator-4.0.3.6.nar
debezium-mongodb Debezium MongoDb Source 4.0.3.6 pulsar-io-debezium-mongodb-4.0.3.6.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.3.6 pulsar-io-debezium-mssql-4.0.3.6.nar
debezium-mysql Debezium MySql Source 4.0.3.6 pulsar-io-debezium-mysql-4.0.3.6.nar
debezium-oracle Debezium Oracle Source 4.0.3.6 pulsar-io-debezium-oracle-4.0.3.6.nar
debezium-postgres Debezium Postgres Source 4.0.3.6 pulsar-io-debezium-postgres-4.0.3.6.nar
kafka Kafka source and sink connector 4.0.3.6 pulsar-io-kafka-4.0.3.6.nar
kinesis Kinesis connectors 4.0.3.6 pulsar-io-kinesis-4.0.3.6.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.1 pulsar-ai-tools-3.2.1.nar
transforms Transformation function 3.2.1 pulsar-transformations-3.2.1.nar

See the environment variables used for the build

Luna Streaming Distribution 4.0 3.4

This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • c179c99bd66 [fix][client] Prevent NPE when seeking with null topic in TopicMessageId (#24404)
  • 46a5bf7a6ee [fix][ml] Enhance OpFindNewest to support skip non-recoverable data (#24441)
  • cdb952c7aad [improve][broker][branch-4.0] Update to Oxia 0.6.0 and use new group-id (#24454)
  • 11d7afdb575 [refactor][broker] Expose the managedLedger field for the sub class (#24448)
  • 3387d98bcd3 [fix][ml]Still got BK ledger, even though it has been deleted after offloaded (#24432)
  • 623841b50ca [improve][broker] Deny removing local cluster from topic level replicated cluster policy (#24351)
  • 9164a2351ff [fix][broker] Once the cluster is configured incorrectly, the broker maintains the incorrect cluster configuration even if you removed it (#24419)
  • 452397d566e [fix][ml]Received more than once callback when calling cursor.delete (#24405)
  • 75f91c2a147 [fix][ml] Cursor ignores the position that has an empty ack-set if disabled deletionAtBatchIndexLevelEnabled (#24406)
  • 9e88dda06b3 [fix][broker] Fix the wrong cache name (#24407)
  • 014ad5d2a96 [fix][client] Fix some potential resource leak (#24402)
  • cb388d2355f [fix][broker][branch-4.0] Revert "[improve][broker] Reduce memory occupation of the delayed message queue (#23611)" (#24429)
  • c3d99c65a71 [fix][txn] Fix deadlock when loading transaction buffer snapshot (#24401)
  • a2859bd7760 [fix] [broker] No longer allow creating subscription that contains slash (#23594)
  • cf0b0ee9250 [fix][ml]Revert a behavior change of releasing idle offloaded ledger handle: only release idle BlobStoreBackedReadHandle (#24384)
  • 6034e76667a [improve][misc] Upgrade Netty to 4.1.122.Final and tcnative to 2.0.72.Final (#24397)
  • deee63e3a62 [improve][broker] Add managedCursor/LedgerInfoCompressionType settings to broker.conf (#24391)
  • ccd54371a2d [improve][broker] Make maxBatchDeletedIndexToPersist configurable and document other related configs (#24392)
  • 7721c2c4895 [fix][client] Fix consumer not returning encrypted messages on decryption failure with compression enabled (#24356)
  • b682de9cbf4 [improve][broker] Added synchronized for sendMessages in Non-Persistent message dispatchers (#24386)
  • 93ee1375f25 [improve][ml]Release idle offloaded read handle only the ref count is 0 (#24381)
  • 209aa342719 [fix][broker]Fix deadlock when compaction and topic deletion execute concurrently (#24366)
  • e1cfe3f564e [fix][broker] expose consumer name for partitioned topic stats (#24360)
  • 113f8bc8aa1 [fix][broker] Fix issue that topic policies was deleted after a sub topic deleted, even if the partitioned topic still exists (#24350)
  • 89bdc3141c2 [fix][io] Acknowledge RabbitMQ message after processing the message successfully (#24354)
  • 7f638dfd6d3 [fix][broker] Ignore metadata changes when broker is not in the Started state (#24352)
  • ca1983c5963 [improve][broker] Enable concurrent processing of pending read Entries to avoid duplicate Reads (#24346)
  • f31ecb2f3c7 [fix][broker] Resolve the issue of frequent updates in message expiration deletion rate (#24190)
  • 9d895268cec [fix][ml] Fix ManagedCursorImpl.individualDeletedMessages concurrent issue (#24338)
  • f5a3b061d50 [fix][offload] Complete the future outside of the reading loop in BlobStoreBackedReadHandleImplV2.readAsync (#24331)
  • 199397c6133 [fix][cli] Fix pulsar-shell cannot produce message with quotes and space (#24320)
  • a986ffa9f73 [fix][test] Fix flaky AutoScaledReceiverQueueSizeTest.testNegativeClientMemory (#24324)
  • 3228d7a04ae [fix][io] Fix kinesis avro bytes handling (#24316)
  • 27011a2025d [improve] Enable metrics for all broker caches (#24365)
  • 22e01e20a1f [improve][broker]Improve the log when encountered in-flight read limitation (#24359)
  • bf2147f986e [improve][ml] Offload ledgers without check ledger length (#24344)
  • 270d3f79d32 [fix][broker]Non-global topic policies and global topic policies overwrite each other (#24286)
  • a5505806369 [fix][broker]Global topic policies do not affect after unloading topic and persistence global topic policies never affect (#24279)
  • b93e161cbfa [fix][test] Fix more resource leaks in tests (#24314)
  • aaaf6331ab8 [cleanup] Remove unused config autoShrinkForConsumerPendingAcksMap (#24315)
  • 28767222d82 [fix][broker] Fix potential deadlock when creating partitioned topic (#24313)
  • d11278ab309 [fix][broker] fix wrong method name checkTopicExists. (#24293)
  • a0078da9bb0 [improve][cli] Make pulsar-perf termination more responsive by using Thread interrupt status (#24309)
  • 415d847b190 [fix][build] Ensure that buildtools is Java 8 compatible and fix remaining compatibility issue (#24307)
  • 2d44251df92 [fix][test] Simplify BetweenTestClassesListenerAdapter and fix issue with BeforeTest/AfterTest annotations (#24304)
  • f38ba5b52cc [improve][io] Add configuration parameter for disabling aggregation for Kinesis Producers (#24289)
  • 21d727d42d0 [fix][broker]fix memory leak, messages lost, incorrect replication state if using multiple schema versions(auto_produce) (#24178)
  • ab628f8e246 Fix group id
  • cac0ce52edb [improve][ci] Add Netty leak detection reporting to Pulsar CI (#24272)
  • e5dbd040599 [improve] Upgrade pulsar-client-python to 3.7.0 in Docker image (#24302)
  • d4dea701cf9 [fix][test] Fix more Netty ByteBuf leaks in tests (#24299)
  • b072ee8b3df [fix][io] Fix SyntaxWarning in Pulsar Python functions (#24297)
  • e891aef43d0 [fix][client] Fix producer publishing getting stuck after message with incompatible schema is discarded (#24282)
  • cbf4ea4da4f [cleanup][test] Remove unused parameter from deleteNamespaceWithRetry method in MockedPulsarServiceBaseTest (#24283)
  • 5e27492079d [improve][build] Improve thread leak detector by ignoring "Attach Listener" thread (#24277)
  • 9e6291291ce [improve][build] Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (#24263)
  • a387d17e02f [fix][test] Fix multiple ByteBuf leaks in tests (#24281)
  • 3918efa2a80 [improve][build] Suppress JVM class sharing warning when running tests (#24278)
  • 40e637227e5 [fix][broker] Fix HashedWheelTimer leak in PulsarService by stopping it in shutdown (#24275)
  • d1afaeac83f [fix][misc] Fix ByteBuf leak in SchemaUtils (#24274)
  • 90f6c63b609 [fix][misc] Fix ByteBuf leaks in tests by making ByteBufPair.coalesce release the input ByteBufPair (#24273)
  • f6e9710d53c [improve][build] Upgrade commons-compress version from 1.27.0 to 1.27.1 (#24270)
  • 1b7932c5e21 [improve][build] Allow building and running tests on JDK 24 and upcoming JDK 25 LTS (#24268)
  • 0f8c0061bd0 [fix][broker]Fix incorrect priority between topic policies and global topic policies (#24254)
  • c3747d69870 [improve][ci] Disable detailed console logging for integration tests in CI (#24266)
  • 3ab114985c9 [improve][build] Upgrade Mockito to 5.17.0 and byte-buddy to 1.15.11 (#24241)
  • a4c8e21da37 [fix][test] Fix flaky ManagedCursorTest.testLastActiveAfterResetCursor and disable failing SchemaTest (#24261)
  • f55a2f4cdb9 [fix][test] Fix flaky ManagedCursorTest.testSkipEntriesWithIndividualDeletedMessages (#24244)
  • 85abaf7f451 [improve][io][kca] support fully-qualified topic names in source records (#24248)
  • 610297e8422 [improve][build] Upgrade Gradle Develocity Maven Extension dependencies (#24260)
  • 645d5f92d93 [fix][test] Fix TestNG BetweenTestClassesListenerAdapter listener (#24258)
  • 0f510acfe73 [fix][broker] Unregister non-static metrics collectors registered in Prometheus default registry (#24257)
  • bd8b19f4225 [cleanup] Remove unused static fields in BrokerService (#24251)
  • 71ddb2cb79d [cleanup] remove unused config messagePublishBufferCheckIntervalInMillis (#24252)
  • a10c4e0b466 [fix] chore: remove unused preciseTopicPublishRateLimiterEnable (#24249)
  • 3661572026c [fix][build] Fix errorprone maven profile configuration (#24246)
  • e83da306e92 [improve][build] Upgrade SpotBugs to 4.9.x (#24243)
  • 9b8b9c90b41 [improve][misc] Migrate from multiple nullness annotation libraries to JSpecify annotations (#24239)
  • 0b3cb4b37af [improve][build] Upgrade to jacoco 0.8.13 (#24240)
  • a6052e7d573 [improve] Adapt startup scripts for Java 24 changes (#24236)
  • 089dbe52471 [improve][build] Upgrade errorprone to 2.38.0 (#24242)
  • b739072e601 [improve][build] Upgrade Lombok to 1.18.38 to support JDK 24 (#24237)
  • 3dbbbaddc73 [fix][test] Fix resource leaks in PulsarBrokerStarterTest (#24235)

lunastreaming-all distribution

CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.1 pulsar-cassandra-admin-2.3.1-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.6 pulsar-jms-admin-6.0.6-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.6 pulsar-jms-6.0.6-nar.nar
Protocol handlers
Name Description Version File
kafka Kafka Protocol Handler 4.0.3.1 pulsar-protocol-handler-kafka-4.0.3.1.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Proxy extensions
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Proxy Extension 4.0.3.1 pulsar-kafka-proxy-4.0.3.1.nar
Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.14 cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
cloud-storage Writes data into cloud storage 3.2.4 pulsar-io-cloud-storage-3.2.4.nar
data-generator Test data generator source 4.0.3.4 pulsar-io-data-generator-4.0.3.4.nar
elastic_search Writes data into Elastic Search 4.0.3.4 pulsar-io-elastic-search-4.0.3.4.nar
http Writes data to an HTTP server (Webhook) 4.0.3.4 pulsar-io-http-4.0.3.4.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.3.4 pulsar-io-jdbc-clickhouse-4.0.3.4.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.3.4 pulsar-io-jdbc-mariadb-4.0.3.4.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.3.4 pulsar-io-jdbc-openmldb-4.0.3.4.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.3.4 pulsar-io-jdbc-postgres-4.0.3.4.nar
jdbc-sqlite JDBC sink for SQLite 4.0.3.4 pulsar-io-jdbc-sqlite-4.0.3.4.nar
kafka Kafka source and sink connector 4.0.3.4 pulsar-io-kafka-4.0.3.4.nar
kinesis Kinesis connectors 4.0.3.4 pulsar-io-kinesis-4.0.3.4.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
snowflake Snowflake Connector 0.2.1 pulsar-snowflake-connector-0.2.1.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.1 pulsar-cassandra-source-2.3.1.nar
data-generator Test data generator source 4.0.3.4 pulsar-io-data-generator-4.0.3.4.nar
debezium-mongodb Debezium MongoDb Source 4.0.3.4 pulsar-io-debezium-mongodb-4.0.3.4.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.3.4 pulsar-io-debezium-mssql-4.0.3.4.nar
debezium-mysql Debezium MySql Source 4.0.3.4 pulsar-io-debezium-mysql-4.0.3.4.nar
debezium-oracle Debezium Oracle Source 4.0.3.4 pulsar-io-debezium-oracle-4.0.3.4.nar
debezium-postgres Debezium Postgres Source 4.0.3.4 pulsar-io-debezium-postgres-4.0.3.4.nar
kafka Kafka source and sink connector 4.0.3.4 pulsar-io-kafka-4.0.3.4.nar
kinesis Kinesis connectors 4.0.3.4 pulsar-io-kinesis-4.0.3.4.nar
lakehouse Lakehouse connectors 3.3.5.2 pulsar-io-lakehouse-3.3.5.2-cloud.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.1 pulsar-ai-tools-3.2.1.nar
transforms Transformation function 3.2.1 pulsar-transformations-3.2.1.nar

Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)

See the environment variables used for the build

Luna Streaming Distribution 4.0 3.3

This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

Most notable commits

  • fff5e69 Fix code style in DefaultLookupProxyHandler
  • aec9ec1 Fix ProxyTest.testGetPartitionedMetadataErrorCode
  • f85b7ee [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763 (#24232)
  • a5ad67c [improve][io] support kafka connect transforms and predicates (#24221)
  • 6c0b79d [improve][client]Improve transaction log when a TXN command timeout (#24230)
  • 3a296fd [fix][broker] Orphan schema after disabled a cluster for a namespace (#24223)
  • c40b89e [fix][broker] Fix ByteBuf memory leak in REST API for publishing messages (#24228)
  • f30c4e2 [fix][client] Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation (#24184)
  • adb43b9 [improve][broker]Improve the feature "Optimize subscription seek (cursor reset) by timestamp": search less entries (#24219)
  • c7922db [improve] Upgrade Netty to 4.1.121.Final (#24214)
  • dca2e53 [fix][test] Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck (#24212)
  • 7bd7f61 [fix][test] Fix multiple resource leaks in tests (#24218)
  • 8c462ff [improve][client] validate ClientConfigurationData earlier to avoid resource leaks (#24187)
  • f5bc20b [fix][broker] Fix HealthChecker deadlock in shutdown (#24216)
  • 950d043 [fix][broker] Fix tenant creation and update with null value (#24209)
  • 1a6b37c [fix][admin] Backlog quota's policy is null which causes a NPE (#24192)
  • 3caf8f2 [improve] Upgrade Apache Commons library versions to compatible versions (#24205)
  • ae47f1f [fix][broker] Fix broker shutdown delay by resolving hanging health checks (#24210)
  • ef10693 [fix][broker] Fix compaction service log's wrong condition (#24207)
  • ed464f8 [fix][test] Fix resource leaks in ProxyTest and fix invalid tests (#24204)
  • d499c63 [improve][io] Upgrade Kafka client and compatible Confluent platform version (#24201)
  • 33e8d3f Revert "[fix][broker] Add topic consistency check (#24118)"
  • a169bc4 Revert "[fix][broker] Directly query single topic existence when the topic is partitioned (#24154)"
  • 7cfe3d4 [fix][test] Fix flaky NamespacesTest.testNamespacesApiRedirects (#24194)
  • 062e2cb [fix][broker] Fix NPE from the wrong iterator in the ownership cleanup job(ExtensibleLoadManagerImpl only) (#24196)
  • 1594e91 [fix][broker] Fix cluster level OffloadedReadPriority to bookkeeper-first does not work (#24151)
  • 6921a49 [fix][broker] Fixes Inconsistent ServiceUnitStateData View (ExtensibleLoadManagerImpl only) (#24186)
  • 67c4c46 [fix][schema] Reject unsupported Avro schema types during schema registration (#24103)
  • eb3fc87 [fix][proxy] Fix incorrect client error when calling get topic metadata (#24181)
  • 32392a2 [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups. (#24091)
  • 8fefcdc [fix][test] Fix remaining UnfinishedStubbingException issue with AuthZTests (#24174)
  • ac38706 [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24171)
  • 2a269d4 [fix][test] Improve reliability of IncrementPartitionsTest (#24172)
  • 53d43ee [fix][build] Fix skipTag and use explicit tag for image name (#24168)
  • c8cfcd9 [fix][test]flaky-test:ManagedLedgerInterceptorImplTest.testManagedLedgerPayloadInputProcessorFailure (#24170)
  • c37342b [fix][broker] Consumer stuck when delete subscription __compaction failed (#23980)
  • 0e7de02 [fix][ml] Fix ML thread blocking issue in internalGetPartitionedStats API (#24167)
  • 1f3b7c4 [fix][test] Fix invalid test CompactionTest.testDeleteCompactedLedgerWithSlowAck (#24166)
  • 7b89129 [fix][test] Fix UnfinishedStubbing issue in AuthZTests (#24165)
  • 8fbab91 [fix][ml] Skip deleting cursor if it was already deleted before calling unsubscribe (#24098)
  • 758e135 [fix][broker] Directly query single topic existence when the topic is partitioned (#24154)
  • 38145e8 [fix][broker] Add topic consistency check (#24118)
  • 164268e [fix][test] Update partitioned topic subscription assertions in IncrementPartitionsTest (#24056)
  • 688c0e5 [cleanup][misc] Add override annotation (#24033)
  • 23b428f [improve][build] Build apachepulsar/pulsar-io-kinesis-sink-kinesis_producer with Alpine 3.21 (#24180)
  • 5247dfa [fix][broker] fix ExtensibleLoadManager to override the ownerships concurrently without blocking load manager thread (#24156)
  • bd61088 [fix][test] Fix flaky BrokerServiceChaosTest.testFetchPartitionedTopicMetadataWithCacheRefresh (#24161)
  • 75e5cb3 [fix][test] Fix flaky BrokerServiceChaosTest (#24162)
  • d049244 [fix][broker] The feature brokerDeleteInactivePartitionedTopicMetadataEnabled leaves orphan topic policies and topic schemas (#24150)
  • 07dc37a modified test to use newConnect method & Getter for FeatureFlags obj in ServerCnx
  • bc01ae8 [fix][proxy] Propagate client connection feature flags through Pulsar Proxy to Broker (#24158)
  • 5fde2a6 [fix][build] Fix docker image building by replacing deprecated and removed compress argument (#24155)
  • 1e55dc0 [fix][misc]: ignore deleted ledger when tear down cluster (#23831)
  • 05de7ce [fix] [broker] topics infinitely failed to delete after remove cluster from replicated clusters modifying when using partitioned system topic (#24097)
  • 10c3dbd [improve][broker] extract getMaxEntriesInThisBatch into a method and add unit test for it (#24117)
  • 38eb99f [fix][sec] Upgrade jwt/v5 to 5.2.2 to address CVE-2025-30204 (#24140)
  • 3164e2d [fix][sec] Upgrade pulsar-function-go dependencies to address CVE-2025-22870 (#24135)
  • f9bde70 [improve][fn] Introduce NewOutputMessageWithError to enable error handling (#24122)
  • 2ef9063 [fix][test] Fix flaky NonPersistentTopicTest.testMsgDropStat (#24134)
  • 4b18610 [fix][io] Fix KinesisSink json flattening for AVRO's SchemaType.BYTES (#24132)

lunastreaming-all distribution

Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.14 cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
cloud-storage Writes data into cloud storage 3.2.4 pulsar-io-cloud-storage-3.2.4.nar
data-generator Test data generator source 4.0.3.3 pulsar-io-data-generator-4.0.3.3.nar
elastic_search Writes data into Elastic Search 4.0.3.3 pulsar-io-elastic-search-4.0.3.3.nar
http Writes data to an HTTP server (Webhook) 4.0.3.3 pulsar-io-http-4.0.3.3.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.3.3 pulsar-io-jdbc-clickhouse-4.0.3.3.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.3.3 pulsar-io-jdbc-mariadb-4.0.3.3.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.3.3 pulsar-io-jdbc-openmldb-4.0.3.3.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.3.3 pulsar-io-jdbc-postgres-4.0.3.3.nar
jdbc-sqlite JDBC sink for SQLite 4.0.3.3 pulsar-io-jdbc-sqlite-4.0.3.3.nar
kafka Kafka source and sink connector 4.0.3.3 pulsar-io-kafka-4.0.3.3.nar
kinesis Kinesis connectors 4.0.3.3 pulsar-io-kinesis-4.0.3.3.nar
snowflake Snowflake Connector 0.2.1 pulsar-snowflake-connector-0.2.1.nar
lakehouse Lakehouse Connector 3.3.3.1 pulsar-io-lakehouse-3.3.3.1.nar
lakehouse-cloud Lakehouse Cloud Connector 3.3.3.1 pulsar-io-lakehouse-3.3.3.1-cloud.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.1 pulsar-cassandra-source-2.3.1.nar
data-generator Test data generator source 4.0.3.3 pulsar-io-data-generator-4.0.3.3.nar
debezium-mongodb Debezium MongoDb Source 4.0.3.3 pulsar-io-debezium-mongodb-4.0.3.3.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.3.3 pulsar-io-debezium-mssql-4.0.3.3.nar
debezium-mysql Debezium MySql Source 4.0.3.3 pulsar-io-debezium-mysql-4.0.3.3.nar
debezium-oracle Debezium Oracle Source 4.0.3.3 pulsar-io-debezium-oracle-4.0.3.3.nar
debezium-postgres Debezium Postgres Source 4.0.3.3 pulsar-io-debezium-postgres-4.0.3.3.nar
kafka Kafka source and sink connector 4.0.3.3 pulsar-io-kafka-4.0.3.3.nar
kinesis Kinesis connectors 4.0.3.3 pulsar-io-kinesis-4.0.3.3.nar
Proxy extensions
Name Description Version File
kafka Kafka Proxy Extension 4.0.3.1 pulsar-kafka-proxy-4.0.3.1.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
Protocol handlers
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 4.0.0.2 starlight-rabbitmq-4.0.0.2.nar
kafka Kafka Protocol Handler 4.0.3.1 pulsar-protocol-handler-kafka-4.0.3.1.nar
CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.1 pulsar-cassandra-admin-2.3.1-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.4 pulsar-jms-admin-6.0.4-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.4 pulsar-jms-6.0.4-nar.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.1 pulsar-ai-tools-3.2.1.nar
transforms Transformation function 3.2.1 pulsar-transformations-3.2.1.nar

Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)

See the environment variables used for the build

Builtin connectors

  • cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
  • pulsar-cassandra-source-2.3.1.nar
  • pulsar-io-cloud-storage-3.2.4.nar
  • pulsar-io-debezium-mongodb-4.0.3.3.nar
  • pulsar-io-jdbc-sqlite-4.0.3.3.nar
  • pulsar-io-kinesis-4.0.3.3.nar
  • pulsar-io-data-generator-4.0.3.3.nar
  • pulsar-io-elastic-search-4.0.3.3.nar
  • pulsar-io-jdbc-clickhouse-4.0.3.3.nar
  • pulsar-io-debezium-oracle-4.0.3.3.nar
  • pulsar-io-jdbc-openmldb-4.0.3.3.nar
  • pulsar-io-jdbc-postgres-4.0.3.3.nar
  • pulsar-io-debezium-mssql-4.0.3.3.nar
  • pulsar-io-debezium-mysql-4.0.3.3.nar
  • pulsar-io-jdbc-mariadb-4.0.3.3.nar
  • pulsar-io-debezium-postgres-4.0.3.3.nar
  • pulsar-io-http-4.0.3.3.nar
  • pulsar-io-kafka-4.0.3.3.nar
  • pulsar-snowflake-connector-0.2.1.nar
  • pulsar-protocol-handler-kafka-4.0.3.1.nar
  • starlight-rabbitmq-4.0.0.2.nar
  • pulsar-kafka-proxy-4.0.3.1.nar
  • pulsar-jms-6.0.4-nar.nar

Luna Streaming Distribution 4.0 3.2

This is the initial release of the DataStax Luna Streaming Distribution for 4.0. This release contains all the commits included in the Apache Pulsar v4.0.3 release plus the following changes specific to Luna Streaming:

Most notable commits

  • 96f25cd [improve][meta] Change log level from error to warn for unknown notification types in OxiaMetadataStore (#24126)
  • ba8037d [fix][ml] Return 1 when bytes size is 0 or negative for entry count estimation (#24131)
  • 167ffea [improve][io] Enhance Kafka connector logging with focused bootstrap server information (#24128)
  • 5edc57c [improve][client] Prevent NullPointException when closing ClientCredentialsFlow (#24123)
  • 21f0750 [fix][ml] Don't estimate number of entries when ledgers are empty, return 1 instead (#24125)
  • f8816e1 [improve][io] Remove sleep when sourceTask.poll of kafka return null (#24124)
  • 71330c4 [improve][broker] Change topic exists log to warn (#24116)
  • d699029 [improve][broker][branch-4.0] PIP-406: Introduce metrics related to dispatch throttled events (#24111)
  • e53623d [fix][client] Pattern subscription regression when broker-side evaluation is disabled (#24104)
  • 3ffcbfc [fix][client] Fix consumer leak when thread is interrupted before subscribe completes (#24100)
  • 83ba1ab [fix][ci] Bump dependency-check to 12.1.0 to fix OWASP Dependency Check job (#24083)
  • 2b933c7 [fix][broker] Restore the behavior to dispatch batch messages according to consumer permits (#24092)
  • fef163c [improve][broker] Optimize message expiration rate repeated update issues (#24073)
  • 814781d [fix][ml] Fix issues in estimateEntryCountBySize (#24089)
  • dc0176e [fix][broker] Fix Metadata Event Synchronizer producer creation retry so that the producer gets created eventually (#24081)
  • 4a5f398 [fix][broker] Fix Metadata event synchronizer should not fail with bad version (#24080)
  • e9aedd2 [fix][broker] Fix NPE while publishing Metadata-Event with not init producer (#24079)
  • cdaec92 [clean][client] Clean code for the construction of retry/dead letter topic name (#24082)
  • 3c6b12a [fix][client] Fix building broken batched message when publishing (#24061)
  • 3efd9bb [fix][broker]Fix failed consumption after loaded up a terminated topic (#24063)
  • f3dfaeb [fix][test] Fix flaky PrometheusMetricsTest.testBrokerMetrics (#24042)
  • aaa2ed1 [fix][broker] http metric endpoint get compaction latency stats always be 0 (#24067)
  • 00fedf9 [fix][client] PIP-409 retry/dead letter topic producer config don't take effect. (#24071)
  • c4b8ca9 [fix][ml] Corrected pulsar_storage_size metric to not multiply offloaded storage by the write quorum (#24054)
  • 9ab3221 [fix][broker] Fix UnsupportedOperationException while setting subscription level dispatch rate policy (#24048)
  • 6dd61f1 [improve][broker] Optimize ThresholdShedder with improved boundary checks and parameter reuse (#24064)
  • 5546d45 [improve][client] PIP-409: support producer configuration for retry/dead letter topic producer (#24020)
  • 1b250e3 [fix][client] Copy eventTime to retry letter topic and DLQ messages (#24059)
  • 379a203 [improve][monitor] Add version=0.0.4 to /metrics content type for Prometheus 3.x compatibility (#24060)
  • dd26654 [fix][broker] Pattern subscription doesn't work when the pattern excludes the topic domain. (#24072)
  • 807a2bc [fix] Avoid negative estimated entry count (#24055)
  • 6b0806a [fix][doc] fix doc related to chunk message feature. (#24023)
  • 9feba1f [fix][broker] Add expire check for replicator (#23975)
  • a9ffcb7 [fix][broker] Fix missing validation when setting retention policy on topic level (#24032)
  • 55dfc00 [fix][broker] fix delay queue sequence issue. (#24035)
  • 2bb61b2 [fix][doc] Workaround Go Yaml issue go-yaml/yaml#789 in docker-compose example (#24040)
  • d9ab831 [improve] Upgrade Netty to 4.1.119.Final (#24049)

lunastreaming-all distribution

Sinks
Name Description Version File
cassandra-enhanced A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) 1.6.13 cassandra-enhanced-pulsar-sink-1.6.13-nar.nar
cloud-storage Writes data into cloud storage 3.2.2 pulsar-io-cloud-storage-3.2.2.nar
data-generator Test data generator source 4.0.3.2 pulsar-io-data-generator-4.0.3.2.nar
elastic_search Writes data into Elastic Search 4.0.3.2 pulsar-io-elastic-search-4.0.3.2.nar
http Writes data to an HTTP server (Webhook) 4.0.3.2 pulsar-io-http-4.0.3.2.nar
jdbc-clickhouse JDBC sink for ClickHouse 4.0.3.2 pulsar-io-jdbc-clickhouse-4.0.3.2.nar
jdbc-mariadb JDBC sink for MariaDB 4.0.3.2 pulsar-io-jdbc-mariadb-4.0.3.2.nar
jdbc-openmldb JDBC sink for OpenMLDB 4.0.3.2 pulsar-io-jdbc-openmldb-4.0.3.2.nar
jdbc-postgres JDBC sink for PostgreSQL 4.0.3.2 pulsar-io-jdbc-postgres-4.0.3.2.nar
jdbc-sqlite JDBC sink for SQLite 4.0.3.2 pulsar-io-jdbc-sqlite-4.0.3.2.nar
kafka Kafka source and sink connector 4.0.3.2 pulsar-io-kafka-4.0.3.2.nar
kinesis Kinesis connectors 4.0.3.2 pulsar-io-kinesis-4.0.3.2.nar
snowflake Snowflake Connector 0.1.15 pulsar-snowflake-connector-0.1.15.nar
lakehouse Lakehouse Connector 3.3.3.1 pulsar-io-lakehouse-3.3.3.1.nar
lakehouse-cloud Lakehouse Cloud Connector 3.3.3.1 pulsar-io-lakehouse-3.3.3.1-cloud.nar
Sources
Name Description Version File
cassandra-source Read data from Cassandra 2.3.1 pulsar-cassandra-source-2.3.1.nar
data-generator Test data generator source 4.0.3.2 pulsar-io-data-generator-4.0.3.2.nar
debezium-mongodb Debezium MongoDb Source 4.0.3.2 pulsar-io-debezium-mongodb-4.0.3.2.nar
debezium-mssql Debezium Microsoft SQL Server Source 4.0.3.2 pulsar-io-debezium-mssql-4.0.3.2.nar
debezium-mysql Debezium MySql Source 4.0.3.2 pulsar-io-debezium-mysql-4.0.3.2.nar
debezium-oracle Debezium Oracle Source 4.0.3.2 pulsar-io-debezium-oracle-4.0.3.2.nar
debezium-postgres Debezium Postgres Source 4.0.3.2 pulsar-io-debezium-postgres-4.0.3.2.nar
kafka Kafka source and sink connector 4.0.3.2 pulsar-io-kafka-4.0.3.2.nar
kinesis Kinesis connectors 4.0.3.2 pulsar-io-kinesis-4.0.3.2.nar
Proxy extensions
Name Description Version File
kafka Kafka Proxy Extension 4.0.3.0 pulsar-kafka-proxy-4.0.3.0.nar
rabbitmq Starlight for RabbitMQ Proxy Extension 2.10.1.0 starlight-rabbitmq-2.10.1.0.nar
Protocol handlers
Name Description Version File
rabbitmq Starlight for RabbitMQ Proxy Extension 2.10.1.0 starlight-rabbitmq-2.10.1.0.nar
kafka Kafka Protocol Handler 4.0.3.0 pulsar-protocol-handler-kafka-4.0.3.0.nar
CLI extensions
Name Description Version File
cassandra-cdc Cassandra CDC - Pulsar Admin Custom Commands 2.3.1 pulsar-cassandra-admin-2.3.1-nar.nar
jms Starlight for JMS - Pulsar Admin Custom Commands 6.0.1 pulsar-jms-admin-6.0.1-nar.nar
Filters
Name Description Version File
jms Starlight for JMS - support for server side filters 6.0.1 pulsar-jms-6.0.1-nar.nar
Functions
Name Description Version File
ai-tools Generative AI tools 3.2.0 pulsar-ai-tools-3.2.0.nar
transforms Transformation function 3.2.0 pulsar-transformations-3.2.0.nar

Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)

See the environment variables used for the build.

Builtin connectors

  • cassandra-enhanced-pulsar-sink-1.6.13-nar.nar
  • pulsar-cassandra-source-2.3.1.nar
  • pulsar-io-cloud-storage-3.2.2.nar
  • pulsar-io-debezium-mongodb-4.0.3.2.nar
  • pulsar-io-jdbc-sqlite-4.0.3.2.nar
  • pulsar-io-kinesis-4.0.3.2.nar
  • pulsar-io-data-generator-4.0.3.2.nar
  • pulsar-io-elastic-search-4.0.3.2.nar
  • pulsar-io-jdbc-clickhouse-4.0.3.2.nar
  • pulsar-io-debezium-oracle-4.0.3.2.nar
  • pulsar-io-jdbc-openmldb-4.0.3.2.nar
  • pulsar-io-jdbc-postgres-4.0.3.2.nar
  • pulsar-io-debezium-mssql-4.0.3.2.nar
  • pulsar-io-debezium-mysql-4.0.3.2.nar
  • pulsar-io-jdbc-mariadb-4.0.3.2.nar
  • pulsar-io-debezium-postgres-4.0.3.2.nar
  • pulsar-io-http-4.0.3.2.nar
  • pulsar-io-kafka-4.0.3.2.nar
  • pulsar-snowflake-connector-0.1.15.nar
  • pulsar-protocol-handler-kafka-4.0.3.0.nar
  • starlight-rabbitmq-2.10.1.0.nar
  • pulsar-kafka-proxy-4.0.3.0.nar
  • pulsar-jms-6.0.1-nar.nar