pulsar-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Pulsar Slack" <apache.pulsar.sl...@gmail.com>
Subject Slack digest for #general - 2019-01-04
Date Fri, 04 Jan 2019 09:11:02 GMT
2019-01-03 09:59:38 UTC - Michael-Yu: i have get this err too, have u solved it or not
----
2019-01-03 14:28:11 UTC - Grant Wu: I haven't
----
2019-01-03 14:28:23 UTC - Grant Wu: We generally chalked it up to unreliable disk
----
2019-01-03 15:39:49 UTC - Jochen Kapaun: @Jochen Kapaun has joined the channel
----
2019-01-03 15:49:06 UTC - Jochen Kapaun: Hi, I tried to start with a Java Client like described
here:
<https://pulsar.apache.org/docs/en/client-libraries-java/>

I added the maven dependency:		
		&lt;dependency&gt;
			&lt;groupId&gt;org.apache.pulsar&lt;/groupId&gt;
			&lt;artifactId&gt;pulsar-client&lt;/artifactId&gt;
			&lt;version&gt;2.2.1&lt;/version&gt;
		&lt;/dependency&gt;

Unfortunately, this dependency does not include the org.apache.pulsar.client.api.PulsarClient

So I cannot compile somthing like this because PulsarClient cannot be resolved.

PulsarClient client = PulsarClient.builder()
        .serviceUrl("<pulsar://localhost:6650>")
        .build();

Any ideas?
----
2019-01-03 16:04:51 UTC - Jochen Kapaun: Please forget what I wrote, it is probably a proxy
problem on my side.
----
2019-01-03 22:05:47 UTC - Emma Pollum: Can someone explain to me the procedure for reading
messages that have been offloaded to either s3 or google cloud?
----
2019-01-03 22:25:46 UTC - Matteo Merli: It’s completely transparent to users
----
2019-01-03 22:26:36 UTC - Matteo Merli: You keep using the same API and tools, irrespective
of where the data is located
----
2019-01-03 22:27:47 UTC - Grant Wu: What is the syntax of the `--user-config` argument to
`pulsar-admin functions create`?
----
2019-01-03 22:31:00 UTC - Jerry Peng: @Grant Wu its a map of key and values in JSON format
----
2019-01-03 22:31:09 UTC - Grant Wu: okay, JSON format
----
2019-01-03 22:31:18 UTC - Grant Wu: provided as a string I’m guessing, not as a file right
----
2019-01-03 22:31:29 UTC - Jerry Peng: yes
----
2019-01-03 22:37:17 UTC - Grant Wu: Is there any chance we could get Python Pulsar functions
that take wheels :slightly_smiling_face:
----
2019-01-03 22:37:33 UTC - Grant Wu: (wheels being the Python package format)
----
2019-01-03 22:37:34 UTC - Matteo Merli: It already does !
----
2019-01-03 22:37:37 UTC - Grant Wu: oh
----
2019-01-03 22:37:38 UTC - Grant Wu: it does?
----
2019-01-03 22:37:56 UTC - Grant Wu: <https://pulsar.apache.org/docs/en/functions-api/#packaging-1>
says it needs to be a single Python file
thinking_face : Grant Wu
----
2019-01-03 22:39:05 UTC - Matteo Merli: Although, fetching dependencies is a bit more tricky.
Though you can also pass a Zip file with all dependencies included.. Docs for this are a bit
ehem, behind. (also the last part of the zip file I think will only be available in 2.3)
----
2019-01-03 22:39:44 UTC - Matteo Merli: @Jerry Peng Can you share any info on how to use wheel
or zip files?
----
2019-01-03 22:39:46 UTC - Grant Wu: last part of the zip file?
----
2019-01-03 22:40:10 UTC - Matteo Merli: I mean, submitting a zip with deps included
----
2019-01-03 22:40:15 UTC - Grant Wu: ah okay
----
2019-01-03 22:40:25 UTC - Matteo Merli: wheel support should be there in 2.2 if I’m not
mistaken
----
2019-01-03 23:42:25 UTC - Grant Wu: ```
Traceback (most recent call last):
  File "/Users/grant.wu/fakebin/apache-pulsar-2.2.1/instances/python-instance/python_instance_main.py",
line 33, in &lt;module&gt;
    import pulsar
  File "/Users/grant.wu/fakebin/apache-pulsar-2.2.1/instances/python-instance/pulsar/__init__.py",
line 99, in &lt;module&gt;
    import _pulsar
ImportError: No module named _pulsar
```
I’m getting this issue with cluster run mode
----
2019-01-03 23:43:14 UTC - Grant Wu: Is there something I’m missing?
----
2019-01-03 23:43:21 UTC - Grant Wu: This is from pulsar standalone logs
----
2019-01-03 23:44:53 UTC - Matteo Merli: you need `pip install pulsar-client` on that machine
----
2019-01-03 23:45:23 UTC - Grant Wu: oh, hrm.
----
2019-01-03 23:53:51 UTC - Grant Wu: Wait - so, to be clear, @Matteo Merli - when deploying
a Python pulsar function - every broker needs to have the `pulsar-client` Python package installed?
----
2019-01-03 23:54:06 UTC - Matteo Merli: yes
----
2019-01-03 23:54:29 UTC - Grant Wu: Do you know if the Pulsar Docker image already handles
that?
----
2019-01-03 23:54:34 UTC - Matteo Merli: yep
+1 : Grant Wu
----
2019-01-03 23:59:03 UTC - Ali Ahmed: @Grant Wu the default image has python 2.7 runtime and
client libs installed
----
2019-01-03 23:59:16 UTC - Grant Wu: oh, hrm.
----
2019-01-03 23:59:47 UTC - Grant Wu: I wish it was Python 3… I think my functions are polyglot
though
----
2019-01-04 00:11:38 UTC - Grant Wu: I’m having trouble using the `publish` function on the
Pulsar context
----
2019-01-04 00:11:56 UTC - Grant Wu: Is there a way to log from Pulsar functions?
----
2019-01-04 00:17:56 UTC - Grant Wu: Just saw <https://apache-pulsar.slack.com/archives/C5Z4T36F7/p1544624357718900>
----
2019-01-04 00:21:43 UTC - Grant Wu: Print seems to work
----
2019-01-04 01:19:00 UTC - Jon Bock: Here’s a short video on how to use log topics:  <https://youtu.be/4LKnkVhsPPk>
----
2019-01-04 02:43:56 UTC - bossbaby: i have a question that have manage offset in pulsart same
kafka?
----
2019-01-04 02:47:20 UTC - Matteo Merli: Pulsar manages offsets, though you have option to
do manual management, if needed
----
2019-01-04 02:47:53 UTC - Matteo Merli: Also, Pulsar really tracks individual messages acks

----
2019-01-04 02:48:46 UTC - bossbaby: you have a document describe it?
----
2019-01-04 03:14:34 UTC - Matteo Merli: @bossbaby <http://pulsar.apache.org/docs/en/concepts-messaging/#acknowledgement>
----
2019-01-04 03:25:19 UTC - bossbaby: thanks you
----
2019-01-04 03:39:50 UTC - bossbaby: Can Pulsar Server store and manage offset of each consumer?
----
2019-01-04 03:44:40 UTC - Matteo Merli: Of each subscription 
----
2019-01-04 04:15:41 UTC - bossbaby: yes, each subscription
----
Mime
View raw message