pulsar-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Pulsar Slack" <apache.pulsar.sl...@gmail.com>
Subject Slack digest for #general - 2018-12-28
Date Fri, 28 Dec 2018 09:11:02 GMT
2018-12-27 11:31:31 UTC - eolivelli: Hi, is Pulsar working with Bookkeeper  4.8.1? I have an
IllegalReferenceCount, I have created issue #3258
2018-12-27 11:41:01 UTC - Sijie Guo: @eolivelli -

- pulsar 2.2.0+ works with 4.7.2+ bookies

however if you are speaking of upgrading the bookkeeper client used by pulsar broker, you
need the changes in <https://github.com/apache/pulsar/pull/2906>

because bk 4.8+ changed the behavior of reference counting in addEntry. so it requires code
changes in managed ledger.

so typically you are okay to upgrade bookies (server) to a newer version. however we recommend
you using the version of bookkeeper client shipped along with pulsar.
2018-12-27 11:41:53 UTC - eolivelli: I see from the poms. I wonder if for next 2.3 you will
upgrade to bk 4.8.x
2018-12-27 11:42:57 UTC - Sijie Guo: #2906 is for 2.3, we will upgrade to bk 4.9.x for python
state support
2018-12-27 13:04:35 UTC - Ganga Lakshmanasamy: How to register a user to receive tweets using
twitter firehose connector. The examples in the website shows connection using command line
but we need to initiate it on demand from java code. Is that possible? Also, do we need to
create a yaml file for each and every user whose twitter data to be synced? Is pulsar by default
comes with this connector or is this need to be manually added?
2018-12-27 16:09:32 UTC - Karthik Palanivelu: Team, I am trying to run the Configuration Store
in the same host as Zookeeper with 2184 port. It started well but when I configure Cluster
Metadata, getting the below error: Can you please let me know where I am making mistake?
16:04:05.953 [NIOServerCxn.Factory:] WARN  org.apache.zookeeper.server.NIOServerCnxn
- Unable to read additional data from client sessionid 0x100000b5e430000, likely client has
closed socket
16:04:05.954 [NIOServerCxn.Factory:] INFO  org.apache.zookeeper.server.NIOServerCnxn
- Closed socket connection for client /IP:40764 which had sessionid 0x100000b5e430000
16:04:36.044 [SessionTracker] INFO  org.apache.zookeeper.server.ZooKeeperServer - Expiring
session 0x100000b5e430000, timeout of 30000ms exceeded
2018-12-27 16:35:40 UTC - Matteo Merli: @eolivelli We’re going to go directly to 4.9. In
any case, Pulsar will work with a 4.8 BK server and Pulsar client doesn’t pull any BK dependency.

If you’re talking embedding a Pulsar broker, there’s also the `pulsar-broker-shaded` option.
2018-12-27 16:37:42 UTC - eolivelli: I will try the 'shaded' artifact. I am re-packaging the
broker and I have bk client 4.8 on the classpath
2018-12-27 17:17:02 UTC - Sijie Guo: @Karthik Palanivelu for the logging, it says zookeeper
session expired. Besides logging, what did you see?
2018-12-27 17:19:36 UTC - Sijie Guo: I am not sure if twitter allows you to do so or not.
I would suggest you check out twitter developer doc and use the twitter connector as an example
to customize a connector that works for your use cases.
2018-12-27 17:40:13 UTC - Karthik Palanivelu: @Sijie Guo Looks running now, I cleaned and
restarted it. Thanks for your help
2018-12-27 19:57:27 UTC - Jackson Li: @Jackson Li has joined the channel
2018-12-27 20:49:15 UTC - Shalin: I keep getting a `503` when I try to register a function
on my cluster Reason: `Function worker service is not done initializing. Please try again
in a little while.` on my local cluster.
2018-12-27 20:50:14 UTC - Sijie Guo: did you enable function worker in brokers or have you
deployed separated function workers?
2018-12-27 20:51:50 UTC - Shalin: No it is not separated. Ah, I guess I need to set `functionsWorkerEnabled`
to true?
2018-12-27 20:53:07 UTC - Sijie Guo: <http://pulsar.apache.org/docs/en/deploy-bare-metal/#enabling-pulsar-functions-optional>
2018-12-27 20:53:24 UTC - Sijie Guo: this is the instruction to enable pulsar functions
2018-12-27 20:54:11 UTC - Shalin: Gotcha, I missed this part. Thanks.
2018-12-28 08:51:18 UTC - Samuel Sun: Hi one question about deletenamespace , this function
is in **deprecation** <https://github.com/apache/pulsar/blob/02df3d2bbf6c4dc893aa1ea0f04221e8d50c72a4/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/NamespacesBase.java#L124>
2018-12-28 08:51:58 UTC - Samuel Sun: means we don’t allow to use it in the future ? so
what’s the instead one ?
View raw message