What is apache atlas

[{"selector":"#anim-9431f976-c37c-4d5c-b921-f16137c871b2","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-82045201-0a56-4e37-a4fb-80d1f081ac40","keyframes":{"transform":["translate3d(0px, 427.83072%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Apache Atlas is open-source data governance and metadata management tool.

[{"selector":"#anim-2bef6d4f-6429-4dd7-b6d5-5326eb434995","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f8d3c4c6-13eb-48c7-9b2d-935cda52fce0","keyframes":{"transform":["translate3d(0px, 206.92732%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Apache Atlas can be easily integrated with popular big data tools like Hadoop, spark Kafka, hive etc.

[{"selector":"#anim-800ad6ec-69e0-434e-a78a-c6b6834d0de0","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a4a50153-7d02-40c1-bc4b-09737fae5324","keyframes":{"transform":["translate3d(0px, 165.13409%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

It allows data engineers to ingest, classify, discover, and govern data assets from various data sources.

[{"selector":"#anim-aa3eff70-8cd4-42f7-b7fc-6e92b1638c21","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e2946db7-d82a-45b1-874e-152da030aeeb","keyframes":{"transform":["translate3d(0px, 165.13409%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Atlas supports Lineage and has a simple UI to view the lineage of data as it moves through various processes

[{"selector":"#anim-f2bd1544-d830-4651-820f-4f483f4ea8dc","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-06061f78-0ffc-4891-9d3d-d42a3fabb423","keyframes":{"transform":["translate3d(0px, 165.13409%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Some of the Capabilities of Apache Atlas are:

[{"selector":"#anim-a335bbd0-f9d0-47e2-a9a9-df814cf83d54","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c01f0969-9f91-451c-acf8-3278f588914e","keyframes":{"transform":["translate3d(0px, 527.43469%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-f79f8723-507f-42ce-9964-30ebd338db5f","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-43672477-478c-427c-96a6-aca9d75a3757","keyframes":{"transform":["translate3d(0px, 726.71922%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-6bcb40a9-6e54-4836-be39-34ecd810ba47","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-b36eb6c2-3ff0-45b3-8e5f-e0cb1eb8dea9","keyframes":{"transform":["translate3d(0px, 591.00501%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-90eba9ea-b897-4f34-b99f-a54a43825e4a","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ef87a191-6147-4cda-9c97-6116d183ef1c","keyframes":{"transform":["translate3d(0px, 457.67173%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-5978f319-61ac-4efd-ac97-f5c522be9d3e","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-0af4cd5a-e449-4953-b82d-226ef12157ba","keyframes":{"transform":["translate3d(0px, 168.17553%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

It has many pre-defined types, and users can add new types based on their requirements.

[{"selector":"#anim-ca7a23b7-f551-402b-9bc9-792aa7e2f2c0","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-43251a1c-583d-4de1-ac0a-11e07914b0b6","keyframes":{"transform":["translate3d(0px, 206.92732%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

It supports a SQL like query engine to search entities.

[{"selector":"#anim-1c43e3a9-053a-484f-9f7c-f377f1c7ccf8","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-dd9364d5-4872-4092-8f39-92f173d95fd9","keyframes":{"transform":["translate3d(0px, 274.77233%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Apache atlas also provides many REST APIs to access and update lineage.

[{"selector":"#anim-42f54c98-1476-43c7-a584-51a4ee1df5e3","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c028d87b-f916-4a31-8928-d00e24e417c3","keyframes":{"transform":["translate3d(0px, 206.92732%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Thank You

[{"selector":"#anim-2628a26d-5302-44e0-8c11-72a7a3e00677","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ec477745-714c-4f03-b0cc-c7f4161b16b1","keyframes":{"transform":["translate3d(0px, 728.74357%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-7727ab37-46f5-458b-a026-77195d34cf0c","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-65b7c511-bfdd-495d-ac33-18434a85a778","keyframes":{"transform":["translate3d(0px, 613.05572%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-782e7a88-7dc8-4e19-b7a3-3ba034766e92","keyframes":{"opacity":[0,1]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4a0a42b7-90ea-4f75-8eff-46db2ec06839","keyframes":{"transform":["translate3d(0px, 197.13637%, 0)","translate3d(0px, 0px, 0)"]},"delay":250,"duration":1400,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

What is apache atlas

The Governance and Compliance tool

Apache Atlas is open-source data governance and metadata management tool.

Apache Atlas can be easily integrated with popular big data tools like Hadoop, spark Kafka, hive etc.

It allows data engineers to ingest, classify, discover, and govern data assets from various data sources.

Atlas supports Lineage and has a simple UI to view the lineage of data as it moves through various processes

Some of the Capabilities of Apache Atlas are:

1. Data Classification

2. Search Lineage

3. Centralized Metadata

4. Security and Policy Engine

It has many pre-defined types, and users can add new types based on their requirements.

It supports a SQL like query engine to search entities.

Apache atlas also provides many REST APIs to access and update lineage.

Thank You

Read More:

Jenkins operator : Future of Jenkins