hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeff saremi <jeffsar...@hotmail.com>
Subject Re: HBase Thrift Client for C#: OutofMemoryException
Date Sat, 14 Jan 2017 00:53:15 GMT
here you go:

https://issues.apache.org/jira/browse/HBASE-17467


________________________________
From: Ted Yu <yuzhihong@gmail.com>
Sent: Friday, January 13, 2017 4:02 PM
To: user@hbase.apache.org
Subject: Re: HBase Thrift Client for C#: OutofMemoryException

bq. i can create a pull request for them

That would be wonderful.

Please log a JIRA, polish the C# example and attach to the JIRA.

In hbase, we're not at the stage of reviewing / committing pull request yet.

On Fri, Jan 13, 2017 at 3:45 PM, jeff saremi <jeffsaremi@hotmail.com> wrote:

> sorry Ted for wasting your time
>
> It happened that i was using the wrong port for this
>
> What a misleading error for an error so common! but that's Thrift
>
>
> On another note i now have converted the Democlient to from hbase-examples
> to C# and i have the generated files as well. If there's interest i can
> create a pull request for them
>
>
>
> ________________________________
> From: jeff saremi <jeffsaremi@hotmail.com>
> Sent: Friday, January 13, 2017 2:11 PM
> To: user@hbase.apache.org
> Subject: Re: HBase Thrift Client for C#: OutofMemoryException
>
> Thanks Ted.
>
> I looked at this. We didn't know that a multipexing protocol existed until
> you mentioned it to us.
> We're using a stock thrift server that is shipped with hbase.
> If you perhaps point us to where we should be checking I'd be appreciative.
>
>
>
> ________________________________
> From: Ted Yu <yuzhihong@gmail.com>
> Sent: Friday, January 13, 2017 1:34 PM
> To: user@hbase.apache.org
> Subject: Re: HBase Thrift Client for C#: OutofMemoryException
>
> I haven't touched C# for a decade.
>
> After a brief search, I found:
> http://stackoverflow.com/questions/17843749/apache-
[https://cdn.sstatic.net/Sites/stackoverflow/img/apple-touch-icon@2.png?v=73d79a89bded]<http://stackoverflow.com/questions/17843749/apache->

Apache Thrift Client Run time issues in c#<http://stackoverflow.com/questions/17843749/apache->
stackoverflow.com
I am working on a client - server application written in C# that is built using the Apache
THRIFT RPC framework. We have created several IDL files (.thrift files) with service definitions.
These


> thrift-client-run-time-issues-in-c-sharp
> [https://cdn.sstatic.net/Sites/stackoverflow/img/apple-touch-icon@2.png?v=
> 73d79a89bded]<http://stackoverflow.com/questions/
> 17843749/apache-thrift-client-run-time-issues-in-c-sharp>
>
> Apache Thrift Client Run time issues in c# - Stack Overflow<
> http://stackoverflow.com/questions/17843749/apache-
> thrift-client-run-time-issues-in-c-sharp>
> stackoverflow.com
> I am working on a client - server application written in C# that is built
> using the Apache THRIFT RPC framework. We have created several IDL files
> (.thrift ...
>
>
>
> Can you take a look at the answer to see if it is relevant ?
>
> Cheers
>
> On Fri, Jan 13, 2017 at 11:10 AM, jeff saremi <jeffsaremi@hotmail.com>
> wrote:
>
> > The result is the same. OutofMemoryException.
> >
> > I again ran my C++ client to make sure nothing wierd is going on server
> > side.
> > I found the thrift compiler here: http://www-us.apache.org/dist/
> Index of /dist - Apache Software Foundation<http://www-us.apache.org/dist/
> >
> www-us.apache.org
> Apache Software Foundation Distribution Directory. The directories linked
> below contain current software releases from the Apache Software Foundation
> projects.
>
>
> Index of /dist - Apache Software Foundation<http://www-us.apache.org/dist/
> >
> Index of /dist - Apache Software Foundation<http://www-us.apache.org/dist/
> >
> www-us.apache.org
> Apache Software Foundation Distribution Directory. The directories linked
> below contain current software releases from the Apache Software Foundation
> projects.
>
>
> www-us.apache.org
> Apache Software Foundation Distribution Directory. The directories linked
> below contain current software releases from the Apache Software Foundation
> projects.
>
>
> > thrift/0.9.3/
> >
> > I regenerated all files and deleted all old ones.
> >
> > Here's a sample of a generated file for you to see that 0.9.3 is used:
> >
> >
> > /**
> >  * Autogenerated by Thrift Compiler (0.9.3)
> >  *
> >  * DO NOT EDIT UNLESS YOU ARE SURE THAT YOU KNOW WHAT YOU ARE DOING
> >  *  @generated
> >  */
> > using System;
> > using System.Collections;
> > using System.Collections.Generic;
> > using System.Text;
> > using System.IO;
> > using Thrift;
> > using Thrift.Collections;
> > using System.Runtime.Serialization;
> > using Thrift.Protocol;
> > using Thrift.Transport;
> >
> > public partial class Hbase {
> >   public interface Iface {
> >
> >
> >
> > ________________________________
> > From: jeff saremi <jeffsaremi@hotmail.com>
> > Sent: Friday, January 13, 2017 10:39 AM
> > To: user@hbase.apache.org
> > Subject: Re: HBase Thrift Client for C#: OutofMemoryException
> >
> >
> > oh i see. sure i'll do that and report back.
> >
> >
> > ________________________________
> > From: Ted Yu <yuzhihong@gmail.com>
> > Sent: Friday, January 13, 2017 10:32 AM
> > To: user@hbase.apache.org
> > Subject: Re: HBase Thrift Client for C#: OutofMemoryException
> >
> > I am not sure about compatibility between thrift 0.10.0 and 0.9.3
> >
> > Is it possible for you to locate 0.9.3 thrift compiler and try again ?
> >
> > On Fri, Jan 13, 2017 at 10:27 AM, jeff saremi <jeffsaremi@hotmail.com>
> > wrote:
> >
> > > I used the following thrift compiler. I did not see any mentions of
> > > versions.
> > > http://www.apache.org/dyn/closer.cgi?path=/thrift/0.10.
> Apache Download Mirrors<http://www.apache.org/
> dyn/closer.cgi?path=/thrift/0.10>
> www.apache.org<http://www.apache.org>
> Home page of The Apache Software Foundation
>
>
> Apache Download Mirrors<http://www.apache.org/
> dyn/closer.cgi?path=/thrift/0.10>
> Apache Download Mirrors<http://www.apache.org/
> dyn/closer.cgi?path=/thrift/0.10>
> www.apache.org<http://www.apache.org>
> Home page of The Apache Software Foundation
>
>
> www.apache.org<http://www.apache.org>
> Home page of The Apache Software Foundation
>
>
> > 0/thrift-0.10.0.exe
> > Apache Download Mirrors<http://www.apache.org/
> > dyn/closer.cgi?path=/thrift/0.10.0/thrift-0.10.0.exe>
> > www.apache.org<http://www.apache.org>
> > Home page of The Apache Software Foundation
> >
> >
> > >
> > >
> > > Here's the stack trace. I am running ANYCPU platform:
> > >
> > >
> > >         private  string ReadStringBody(int size)
> > >         {
> > >             byte[] buf = new byte[size];
> > >
> > >
> > > size = 1213486160
> > >
> > >
> > >
> > >    at Thrift.Protocol.TBinaryProtocol.ReadStringBody(Int32 size) in
> > > D:\repos\thrift\lib\csharp\src\Protocol\TBinaryProtocol.cs:line 383
> > >    at Thrift.Protocol.TBinaryProtocol.ReadMessageBegin() in
> > > D:\repos\thrift\lib\csharp\src\Protocol\TBinaryProtocol.cs:line 239
> > >    at Hbase.Client.recv_getTableNames() in
> > D:\Projects\HBaseThrift\Hbase.cs:line
> > > 1418
> > >    at Hbase.Client.getTableNames() in D:\Projects\HBaseThrift\Hbase.
> > cs:line
> > > 1391
> > >    at DemoClient.Main(String[] args) in D:\Projects\HBaseThriftClient\
> > DemoClient.cs:line
> > > 97
> > >    at System.AppDomain._nExecuteAssembly(RuntimeAssembly assembly,
> > > String[] args)
> > >    at System.AppDomain.ExecuteAssembly(String assemblyFile, Evidence
> > > assemblySecurity, String[] args)
> > >    at Microsoft.VisualStudio.HostingProcess.HostProc.
> RunUsersAssembly()
> > >    at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
> > >    at System.Threading.ExecutionContext.RunInternal(ExecutionContext
> > > executionContext, ContextCallback callback, Object state, Boolean
> > > preserveSyncCtx)
> > >    at System.Threading.ExecutionContext.Run(ExecutionContext
> > > executionContext, ContextCallback callback, Object state, Boolean
> > > preserveSyncCtx)
> > >    at System.Threading.ExecutionContext.Run(ExecutionContext
> > > executionContext, ContextCallback callback, Object state)
> > >    at System.Threading.ThreadHelper.ThreadStart()
> > >
> > >
> > > ________________________________
> > > From: Ted Yu <yuzhihong@gmail.com>
> > > Sent: Friday, January 13, 2017 10:00 AM
> > > To: user@hbase.apache.org
> > > Subject: Re: HBase Thrift Client for C#: OutofMemoryException
> > >
> > > Which thrift version did you use to generate c# code ?
> > >
> > > hbase uses 0.9.3
> > >
> > > Can you pastebin the whole stack trace for the exception ?
> > >
> > > I assume you run your code on 64-bit machine.
> > >
> > > Cheers
> > >
> > > On Fri, Jan 13, 2017 at 9:53 AM, jeff saremi <jeffsaremi@hotmail.com>
> > > wrote:
> > >
> > > > I have cloned the latest thrift and hbase code. Used thrift generator
> > to
> > > > generate c# code from hbase-thrift\src\main\
> > resources\org\apache\hadoop\
> > > hbase\thrift.
> > > > Then created a single VS solution with the generated code, the thrift
> > lib
> > > > for c# (thrift\lib\csharp\src\Thrift.csproj) and i also added a
> > > > DemoClient (hbase-examples) converted from c++ to c#. When I run
> that I
> > > > keep getting OutofMemoryException with not a lot of other useful
> > > > information. I have done the same process for C++ and the democlient
> > code
> > > > from hbase-examples runs with no issues at all.
> > > >
> > > >
> > > > here's the client code:
> > > >
> > > > TTransport socket = new TSocket(args[0], Convert.ToInt32(args[1]));
> > > > TTransport transport = new TBufferedTransport((
> > TStreamTransport)socket);
> > > > TProtocol protocol = new TBinaryProtocol(transport);
> > > > Hbase.Client client = new Hbase.Client(protocol);
> > > > List<byte[]> tables = client.getTableNames();
> > > >
> > > > The last line is where the exception is thrown. thanks
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message