org.apache.hudi.schema

Class SchemaRegistryProvider

java.lang.Object

org.apache.hudi.schema.SchemaProvider

org.apache.hudi.schema.SchemaRegistryProvider

All Implemented Interfaces:

Serializable

public class SchemaRegistryProvider
extends SchemaProvider

Obtains latest schema from the Confluent/Kafka schema-registry.

https://github.com/confluentinc/schema-registry

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SchemaRegistryProvider.Config Configs supported.

Constructor Summary

Constructors

Constructor and Description
SchemaRegistryProvider(TypedProperties props)

Method Summary

Modifier and Type	Method and Description
String	fetchSchemaFromRegistry(String registryUrl) The method takes the provided url registryUrl and gets the schema from the schema registry using that url.
org.apache.avro.Schema	getSourceSchema()
protected InputStream	getStream(HttpURLConnection connection)
org.apache.avro.Schema	getTargetSchema()
protected void	setAuthorizationHeader(String creds, HttpURLConnection connection)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SchemaRegistryProvider

public SchemaRegistryProvider(TypedProperties props)

Method Detail

fetchSchemaFromRegistry

public String fetchSchemaFromRegistry(String registryUrl)
                               throws IOException

The method takes the provided url registryUrl and gets the schema from the schema registry using that url. If the caller provides userInfo credentials in the url (e.g "https://foo:bar@schemaregistry.org") then the credentials are extracted the url using the Matcher and the extracted credentials are set on the request as an Authorization header.

Parameters:

registryUrl -

Returns:

the Schema in String form.

Throws:

IOException

setAuthorizationHeader

protected void setAuthorizationHeader(String creds,
                                      HttpURLConnection connection)

getStream

protected InputStream getStream(HttpURLConnection connection)
                         throws IOException

Throws:

IOException

getSourceSchema

public org.apache.avro.Schema getSourceSchema()

Specified by:

getSourceSchema in class SchemaProvider

getTargetSchema

public org.apache.avro.Schema getTargetSchema()

Overrides:

getTargetSchema in class SchemaProvider