atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Madhan Neethiraj (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (ATLAS-445) Embedded Kafka mode: All kafka threads are in indefinite wait state when an entity create message is sent to ATLAS_ENTITIES topic
Date Mon, 18 May 2020 02:16:00 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Madhan Neethiraj resolved ATLAS-445.
------------------------------------
    Resolution: Abandoned

> Embedded Kafka mode: All kafka threads are in indefinite wait state when an entity create
message is sent to ATLAS_ENTITIES topic
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: ATLAS-445
>                 URL: https://issues.apache.org/jira/browse/ATLAS-445
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: trunk
>            Reporter: Ayub Pathan
>            Priority: Major
>         Attachments: atlas_full_thread_dump.txt
>
>
> When a create entity request is fired thru rest api, the request hangs indefinitely without
any response.
> From the logs, looks like the entity is getting created, when the entity creation notification
is sent to ATLAS_ENTITIES topic, somehow all kafka threads are moving to indefinite wait state.
This can be resolved by adding a acceptable amount of timeout for the wait state.
> Log snapshot
> {noformat}
> } of DB to vertex v[7683072] (TypedInstanceToGraphMapper:175)
> 2016-01-19 14:28:36,479 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding/Updating typed instance DB (TypedInstanceToGraphMapper:149)
> 2016-01-19 14:28:36,480 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping instance {
>         id : (type: DB, id: <unassigned>)
>         name :  Sales
>         description :   Sales Database
>         locationUri :   hdfs://host:8000/apps/warehouse/sales
>         owner :         John ETL
>         createTime :    1453193717096
> } of DB to vertex v[7683072] (TypedInstanceToGraphMapper:175)
> 2016-01-19 14:28:36,480 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ mapping attribute name = Sales (TypedInstanceToGraphMapper:188)
> 2016-01-19 14:28:36,480 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Setting property DB.name = "Sales" to vertex v[7683072] (GraphHelper:152)
> 2016-01-19 14:28:36,481 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ mapping attribute description = Sales Database (TypedInstanceToGraphMapper:188)
> 2016-01-19 14:28:36,481 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Setting property DB.description = "Sales Database" to vertex v[7683072] (GraphHelper:152)
> 2016-01-19 14:28:36,481 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ mapping attribute locationUri = hdfs://host:8000/apps/warehouse/sales (TypedInstanceToGraphMapper:188)
> 2016-01-19 14:28:36,482 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Setting property DB.locationUri = "hdfs://host:8000/apps/warehouse/sales" to vertex v[7683072]
(GraphHelper:152)
> 2016-01-19 14:28:36,482 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ mapping attribute owner = John ETL (TypedInstanceToGraphMapper:188)
> 2016-01-19 14:28:36,482 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Setting property DB.owner = "John ETL" to vertex v[7683072] (GraphHelper:152)
> 2016-01-19 14:28:36,483 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ mapping attribute createTime = 1453193717096 (TypedInstanceToGraphMapper:188)
> 2016-01-19 14:28:36,483 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Setting property DB.createTime = "1453193717096" to vertex v[7683072] (GraphHelper:152)
> 2016-01-19 14:28:36,484 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping graph root vertex v[7683072] to typed instance for guid 8a20f8cb-a202-401f-9833-36d53c2c554a
(GraphToTypedInstanceMapper:63)
> 2016-01-19 14:28:36,485 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Created id (type: DB, id: 8a20f8cb-a202-401f-9833-36d53c2c554a) for instance type DB (GraphToTypedInstanceMapper:68)
> 2016-01-19 14:28:36,485 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping vertex v[7683072] to instance DB for fields (GraphToTypedInstanceMapper:92)
> 2016-01-19 14:28:36,485 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo name (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,486 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='name', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,486 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo description (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,486 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='description', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,486 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo locationUri (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,487 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='locationUri', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,487 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo owner (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,487 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='owner', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,487 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo createTime (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,487 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='createTime', dataType=org.apache.atlas.typesystem.types.DataTypes$LongType@c2be72,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,488 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Setting property entityText = "DB  name Sales description Sales Database locationUri hdfs://host:8000/apps/warehouse/sales
owner John ETL createTime 1453193717096" to vertex v[7683072] (GraphHelper:152)
> 2016-01-19 14:28:36,528 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ graph commit (GraphTransactionInterceptor:44)
> 2016-01-19 14:28:36,529 INFO  - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Retrieving entity with guid=8a20f8cb-a202-401f-9833-36d53c2c554a (GraphBackedMetadataRepository:136)
> 2016-01-19 14:28:36,529 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Finding vertex for __guid=8a20f8cb-a202-401f-9833-36d53c2c554a (GraphHelper:115)
> 2016-01-19 14:28:36,530 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Found a vertex v[7683072] with __guid=8a20f8cb-a202-401f-9833-36d53c2c554a (GraphHelper:196)
> :set nonu
> 2016-01-19 14:28:36,529 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Finding vertex for __guid=8a20f8cb-a202-401f-9833-36d53c2c554a (GraphHelper:115)
> 2016-01-19 14:28:36,530 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Found a vertex v[7683072] with __guid=8a20f8cb-a202-401f-9833-36d53c2c554a (GraphHelper:196)
> 2016-01-19 14:28:36,530 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping graph root vertex v[7683072] to typed instance for guid 8a20f8cb-a202-401f-9833-36d53c2c554a
(GraphToTypedInstanceMapper:63)
> 2016-01-19 14:28:36,530 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Created id (type: DB, id: 8a20f8cb-a202-401f-9833-36d53c2c554a) for instance type DB (GraphToTypedInstanceMapper:68)
> 2016-01-19 14:28:36,530 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping vertex v[7683072] to instance DB for fields (GraphToTypedInstanceMapper:92)
> 2016-01-19 14:28:36,530 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo name (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,531 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='name', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,531 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo description (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,531 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='description', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,531 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo locationUri (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,531 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='locationUri', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,532 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo owner (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,532 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='owner', dataType=org.apache.atlas.typesystem.types.DataTypes$StringType@72a6e257,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,532 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Mapping attributeInfo createTime (GraphToTypedInstanceMapper:102)
> 2016-01-19 14:28:36,532 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Adding primitive AttributeInfo{name='createTime', dataType=org.apache.atlas.typesystem.types.DataTypes$LongType@c2be72,
multiplicity=Multiplicity{lower=0, upper=1, isUnique=false}, isComposite=false, isUnique=false,
isIndexable=true, reverseAttributeName='null'} from vertex v[7683072] (GraphToTypedInstanceMapper:357)
> 2016-01-19 14:28:36,533 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ graph commit (GraphTransactionInterceptor:44)
> 2016-01-19 14:28:36,534 DEBUG - [qtp161161313-962 - efd6fd5a-c1c0-4731-8ebd-66fa6d01fb37:]
~ Sending message for topic ATLAS_ENTITIES: {"entity":{"jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Reference","id":{"jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Id","id":"8a20f8cb-a202-401f-9833-36d53c2c554a","version":0,"typeName":"DB"},"typeName":"DB","values":{"name":"Sales","createTime":1453193717096,"description":"Sales
Database","locationUri":"hdfs://host:8000/apps/warehouse/sales","owner":"John ETL"},"traitNames":[],"traits":{}},"operationType":"ENTITY_CREATE","traits":[]}
(KafkaNotification:186)
> {noformat}
> Also attaching full thread dump of atlas and kafka.
> Note: This seems to be a corner case because restarting atlas would bring it back to
normal state.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message