--- results/org.apache.nifi/nifi/2.0.0-M4/oss-rebuild/reference/nifi-record-serialization-services-nar-2.0.0-M4-nar-extension-manifest.xml:extension-manifest.xml 2025-04-04 15:05:45.925469692 +0000 +++ results/org.apache.nifi/nifi/2.0.0-M4/oss-rebuild/rebuild/nifi-record-serialization-services-nar-2.0.0-M4-nar-extension-manifest.xml:extension-manifest.xml 2025-04-04 15:05:51.833376931 +0000 @@ -2,4 +2,4 @@ Handling of duplicate header names is CSV Parser specific (where applicable): * Apache Commons CSV - duplicate headers will result in column data "shifting" right with new fields created for "unknown_field_index_X" where "X" is the CSV column index number * Jackson CSV - duplicate headers will be de-duplicated with the field value being that of the right-most duplicate CSV column -* FastCSV - duplicate headers will be de-duplicated with the field value being that of the left-most duplicate CSV columntruetruetruefalsefalsefalsefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomTrim double quoteTrim double quoteWhether or not to trim starting and ending double quotes. For example: with trim string '"test"' would be parsed to 'test', without trim would be parsed to '"test"'.If set to 'false' it means full compliance with RFC-4180. Default value is true, with trim.truetruetruefalsefalsetruefalsefalseNONEfalsefalseCSV FormatCSV Formatrfc-4180org.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.csv.CSVRecordSetWriterCONTROLLER_SERVICEWrites the contents of a RecordSet as CSV data. The first line written will be the column names (unless the 'Include Header Line' property is false). All subsequent lines will be the values corresponding to the record fields.csvresultsetrecordsetrecordwriterserializerrowtsvtabseparateddelimitedSchema Write StrategySchema Write StrategySpecifies how the schema for a Record should be added to the data.no-schemaDo Not Write Schemano-schemaDo not add any schema-related information to the FlowFile.Set 'schema.name' Attributeschema-nameThe FlowFile will be given an attribute named 'schema.name' and this attribute will indicate the name of the schema in the Schema Registry. Note that ifthe schema for a record is not obtained from a Schema Registry, then no attribute will be added.Set 'avro.schema' Attributefull-schema-attributeThe FlowFile will be given an attribute named 'avro.schema' and this attribute will contain the Avro Schema that describes the records in the FlowFile. The contents of the FlowFile need not be Avro, but the text of the schema will be used.Schema Reference Writerschema-reference-writerThe schema reference information will be written through a configured Schema Reference Writer service implementation.truefalsefalseNONEfalsefalseschema-cacheSchema CacheSpecifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseSchema Reference WriterSchema Reference WriterService implementation responsible for writing FlowFile attributes or content header with Schema reference informationorg.apache.nifi.schemaregistry.services.SchemaReferenceWriterorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseSchema Write StrategySchema Write Strategyschema-reference-writerschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.inherit-record-schemaInherit Record Schemainherit-record-schemaThe schema used to write records will be the same schema that was given to the Record when the Record was created.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseCSV FormatCSV FormatSpecifies which "format" the CSV data is in, or specifies if custom formatting should be used.customCustom FormatcustomThe format of the CSV is configured by using the properties of this Controller Service, such as Value SeparatorRFC 4180rfc-4180CSV data follows the RFC 4180 Specification defined at https://tools.ietf.org/html/rfc4180Microsoft ExcelexcelCSV data follows the format used by Microsoft ExcelTab-DelimitedtdfCSV data is Tab-Delimited instead of Comma DelimitedMySQL FormatmysqlCSV data follows the format used by MySQLInformix Unloadinformix-unloadThe format used by Informix when issuing the UNLOAD TO file_name commandInformix Unload Escape Disabledinformix-unload-csvThe format used by Informix when issuing the UNLOAD TO file_name command with escaping disabledtruefalsefalseNONEfalsefalsecsv-writerCSV WriterSpecifies which writer implementation to use to write CSV records. NOTE: Different writers may support different subsets of functionality and may also exhibit different levels of performance.commons-csvApache Commons CSVcommons-csvThe CSV writer implementation from the Apache Commons CSV library.FastCSVfast-csvThe CSV writer implementation from the FastCSV library. NOTE: This writer only officially supports RFC-4180, so it recommended to set the 'CSV Format' property to 'RFC 4180'. It does handle some non-compliant CSV data, for that case set the 'CSV Format' property to 'CUSTOM' and the other custom format properties (such as 'Trim Fields', 'Trim double quote', etc.) as appropriate. Be aware that this may cause errors if FastCSV doesn't handle the property settings correctly (such as 'Quote Mode'), but otherwise may process the output as expected even if the data is not fully RFC-4180 compliant.truefalsefalseNONEfalsefalseValue SeparatorValue SeparatorThe character that is used to separate values/fields in a CSV Record. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Value Separator at runtime, then it will be skipped and the default Value Separator will be used.,truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomInclude Header LineInclude Header LineSpecifies whether or not the CSV column names should be written out as the first line.truetruetruefalsefalsetruefalsefalseNONEfalsefalseQuote CharacterQuote CharacterThe character that is used to quote values so that escape characters do not have to be used. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Quote Character at runtime, then it will be skipped and the default Quote Character will be used."truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomEscape CharacterEscape CharacterThe character that is used to escape characters that would otherwise have a specific meaning to the CSV Parser. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Escape Character at runtime, then it will be skipped and the default Escape Character will be used. Setting it to an empty string means no escape character should be used.\truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomComment MarkerComment MarkerThe character that is used to denote the start of a comment. Any line that begins with this comment will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomNull StringNull StringSpecifies a String that, if present as a value in the CSV, should be considered a null field instead of using the literal value.falsefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomTrim FieldsTrim FieldsWhether or not white space should be removed from the beginning and end of fieldstruetruetruefalsefalsetruefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomQuote ModeQuote ModeSpecifies how fields should be quoted when they are writtenMINIMALQuote All ValuesALLAll values will be quoted using the configured quote character.Quote MinimalMINIMALValues will be quoted only if they are contain special characters such as newline characters or field separators.Quote Non-Numeric ValuesNON_NUMERICValues will be quoted unless the value is a number.Do Not Quote ValuesNONEValues will not be quoted. Instead, all special characters will be escaped using the configured escape character.truefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomRecord SeparatorRecord SeparatorSpecifies the characters to use in order to separate CSV Records\ntruefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomInclude Trailing DelimiterInclude Trailing DelimiterIf true, a trailing delimiter will be added to each CSV Record that is written. If false, the trailing delimiter will be omitted.falsetruetruefalsefalsetruefalsefalseNONEfalsefalseCSV FormatCSV Formatcustomcsvutils-character-setCharacter SetThe Character Encoding that is used to encode/decode the CSV fileUTF-8truefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.grok.GrokReaderCONTROLLER_SERVICEProvides a mechanism for reading unstructured text data, such as log files, and structuring the data so that it can be processed. The service is configured using Grok patterns. The service reads from a stream of data and splits each message that it finds into a separate Record, each containing the fields that are configured. If a line in the input does not match the expected message pattern, the line of text is either considered to be part of the previous message or is skipped, depending on the configuration, with the exception of stack traces. A stack trace that is found at the end of a log message is considered to be part of the previous message but is added to the 'stackTrace' field of the Record. If a record has no stack trace, it will have a NULL value for the stackTrace field (assuming that the schema does in fact include a stackTrace field of type String). Assuming that the schema includes a '_raw' field of type String, the raw message will be included in the Record.groklogslogfilesparseunstructuredtextrecordreaderregexpatternlogstashschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.string-fields-from-grok-expressionUse String Fields From Grok Expressionstring-fields-from-grok-expressionThe schema will be derived using the field names present in all configured Grok Expressions. All schema fields will have a String type and will be marked as nullable. The schema will also include a `stackTrace` field, and a `_raw` field containing the input line string.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerGrok Pattern FileGrok PatternsGrok Patterns to use for parsing logs. If not specified, a built-in default Pattern file will be used. If specified, all patterns specified will override the default patterns. See the Controller Service's Additional Details for a list of pre-defined patterns.falsefalsetrueENVIRONMENTfalsefalseSINGLEFILEURLTEXTGrok ExpressionGrok ExpressionsSpecifies the format of a log line in Grok format. This allows the Record Reader to understand how to parse each log line. The property supports one or more Grok expressions. The Reader attempts to parse input lines according to the configured order of the expressions.If a line in the log file does not match any expressions, the line will be assumed to belong to the previous log message.If other Grok patterns are referenced by this expression, they need to be supplied in the Grok Pattern File property.truefalsefalseNONEfalsefalseSINGLEFILEURLTEXTno-match-behaviorNo Match BehaviorIf a line of text is encountered and it does not match the given Grok Expression, and it is not part of a stack trace, this property specifies how the text should be processed.append-to-previous-messageAppend to Previous Messageappend-to-previous-messageThe line of text that does not match the Grok Expression will be appended to the last field of the prior message.Skip Lineskip-lineThe line of text that does not match the Grok Expression will be skipped.Raw Lineraw-lineThe line of text that does not match the Grok Expression will only be added to the _raw field.truefalsefalseNONEfalsefalsereference remote resourcesPatterns and Expressions can reference resources over HTTPorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.json.JsonPathReaderCONTROLLER_SERVICEParses JSON records and evaluates user-defined JSON Path's against each JSON object. While the reader expects each record to be well-formed JSON, the content of a FlowFile may consist of many records, each as a well-formed JSON array or JSON object with optional whitespace between them, such as the common 'JSON-per-line' format. If an array is encountered, each element in that array will be treated as a separate record. User-defined properties define the fields that should be extracted from the JSON in order to form the fields of a Record. Any JSON field that is not extracted via a JSONPath will not be returned in the JSON Records.jsonjsonpathrecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaUse 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.Infer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerMax String LengthMax String LengthThe maximum allowed length of a string value when parsing the JSON document20 MBtruefalsefalseNONEfalsefalseAllow CommentsAllow CommentsWhether to allow comments when parsing the JSON documentfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseThe field name for the record.A JSONPath Expression that will be evaluated against each JSON record. The result of the JSONPath will be the value of the field whose name is the same as the property name.User-defined properties identify how to extract specific fields from a JSON object in order to create a RecordNONEorg.apache.nifi.json.JsonTreeReaderorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.json.JsonRecordSetWriterCONTROLLER_SERVICEWrites the results of a RecordSet as either a JSON Array or one JSON object per line. If using Array output, then even if the RecordSet consists of a single row, it will be written as an array with a single element. If using One Line Per Object output, the JSON objects cannot be pretty-printed.jsonresultsetwriterserializerecordrecordsetrowSchema Write StrategySchema Write StrategySpecifies how the schema for a Record should be added to the data.no-schemaDo Not Write Schemano-schemaDo not add any schema-related information to the FlowFile.Set 'schema.name' Attributeschema-nameThe FlowFile will be given an attribute named 'schema.name' and this attribute will indicate the name of the schema in the Schema Registry. Note that ifthe schema for a record is not obtained from a Schema Registry, then no attribute will be added.Set 'avro.schema' Attributefull-schema-attributeThe FlowFile will be given an attribute named 'avro.schema' and this attribute will contain the Avro Schema that describes the records in the FlowFile. The contents of the FlowFile need not be Avro, but the text of the schema will be used.Schema Reference Writerschema-reference-writerThe schema reference information will be written through a configured Schema Reference Writer service implementation.truefalsefalseNONEfalsefalseschema-cacheSchema CacheSpecifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseSchema Reference WriterSchema Reference WriterService implementation responsible for writing FlowFile attributes or content header with Schema reference informationorg.apache.nifi.schemaregistry.services.SchemaReferenceWriterorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseSchema Write StrategySchema Write Strategyschema-reference-writerschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.inherit-record-schemaInherit Record Schemainherit-record-schemaThe schema used to write records will be the same schema that was given to the Record when the Record was created.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalsePretty Print JSONPretty Print JSONSpecifies whether or not the JSON should be pretty printedfalsetruetruefalsefalsetruefalsefalseNONEfalsefalsesuppress-nullsSuppress Null ValuesSpecifies how the writer should handle a null fieldnever-suppressNever Suppressnever-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will be written out as a null valueAlways Suppressalways-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will not be written outSuppress Missing Valuessuppress-missingWhen a field has a value of null, it will be written out. However, if a field is defined in the schema and not present in the record, the field will not be written out.truefalsefalseNONEfalsefalseAllow Scientific NotationAllow Scientific NotationSpecifies whether or not scientific notation should be used when writing numbersfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseoutput-groupingOutput GroupingSpecifies how the writer should output the JSON records (as an array or one object per line, e.g.) Note that if 'One Line Per Object' is selected, then Pretty Print JSON must be false.output-arrayArrayoutput-arrayOutput records as a JSON arrayOne Line Per Objectoutput-onelineOutput records with one JSON object per line, delimited by a newline charactertruefalsefalseNONEfalsefalsecompression-formatCompression FormatThe compression format to use. Valid values are: GZIP, BZIP2, ZSTD, XZ-LZMA2, LZMA, Snappy, and Snappy Framednonenonenonegzipgzipbzip2bzip2xz-lzma2xz-lzma2snappysnappysnappy framedsnappy framedzstdzstdtruefalsefalseNONEfalsefalsecompression-levelCompression LevelThe compression level to use; this is valid only when using GZIP compression. A lower value results in faster processing but less compression; a value of 0 indicates no compression but simply archiving100112233445566778899truefalsefalseNONEfalsefalsecompression-formatCompression Formatgziporg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.json.JsonTreeReaderCONTROLLER_SERVICEParses JSON into individual Record objects. While the reader expects each record to be well-formed JSON, the content of a FlowFile may consist of many records, each as a well-formed JSON array or JSON object with optional whitespace between them, such as the common 'JSON-per-line' format. If an array is encountered, each element in that array will be treated as a separate record. If the schema that is configured contains a field that is not present in the JSON, a null value will be used. If the JSON contains a field that is not present in the schema, that field will be skipped. See the Usage of the Controller Service for more information and examples.jsontreerecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaInfer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-inference-cacheSchema Inference CacheSpecifies a Schema Cache to use when inferring the schema. If not populated, the schema will be inferred each time. However, if a cache is specified, the cache will first be consulted and if the applicable schema can be found, it will be used instead of inferring the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyinfer-schemastarting-field-strategyStarting Field StrategyStart processing from the root node or from a specified nested node.ROOT_NODERoot NodeROOT_NODEBegins processing from the root node.Nested FieldNESTED_FIELDSkips forward to the given nested JSON field (array or object) to begin processing.truefalsefalseNONEfalsefalsestarting-field-nameStarting Field NameSkips forward to the given nested JSON field (array or object) to begin processing.falsefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-application-strategySchema Application StrategySpecifies whether the schema is defined for the whole JSON or for the selected part starting from "Starting Field Name".SELECTED_PARTWhole JSONWHOLE_JSONApplies the schema for the whole JSON.Selected PartSELECTED_PARTApplies the schema for the selected part starting from the "Starting Field Name".truefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-text-propertyMax String LengthMax String LengthThe maximum allowed length of a string value when parsing the JSON document20 MBtruefalsefalseNONEfalsefalseAllow CommentsAllow CommentsWhether to allow comments when parsing the JSON documentfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseorg.apache.nifi.json.JsonPathReaderorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.lookup.ReaderLookupCONTROLLER_SERVICEProvides a RecordReaderFactory that can be used to dynamically select another RecordReaderFactory. This will allow multiple RecordReaderFactories to be defined and registered, and then selected dynamically at runtime by referencing a FlowFile attribute in the Service to Use property.lookupparserecordrowreaderService to UseService to UseSpecifies the name of the user-defined property whose associated Controller Service should be used.${recordreader.name}truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseName of the RecordReaderA RecordReaderFactory controller serviceNONEorg.apache.nifi.lookup.RecordSetWriterLookuporg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.lookup.RecordSetWriterLookupCONTROLLER_SERVICEProvides a RecordSetWriterFactory that can be used to dynamically select another RecordSetWriterFactory. This will allow multiple RecordSetWriterFactory's to be defined and registered, and then selected dynamically at runtime by tagging FlowFiles with the attributes and referencing those attributes in the Service to Use property.lookupresultsetwriterserializerrecordrecordsetrowService to UseService to UseSpecifies the name of the user-defined property whose associated Controller Service should be used.${recordsetwriter.name}truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseName of the RecordSetWriterA RecordSetWriterFactory controller serviceNONEorg.apache.nifi.lookup.ReaderLookuporg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.schema.inference.VolatileSchemaCacheCONTROLLER_SERVICEProvides a Schema Cache that evicts elements based on a Least-Recently-Used algorithm. This cache is not persisted, so any restart of NiFi will result in the cache being cleared. Additionally, the cache will be cleared any time that the Controller Service is stopped and restarted.recordschemacachemax-cache-sizeMaximum Cache SizeThe maximum number of Schemas to cache.100truefalsetrueENVIRONMENTfalsefalseorg.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.syslog.Syslog5424ReaderCONTROLLER_SERVICEProvides a mechanism for reading RFC 5424 compliant Syslog data, such as log files, and structuring the data so that it can be processed.syslog 5424sysloglogslogfilesparsetextrecordreaderCharacter SetCharacter SetSpecifies which character set of the Syslog messagesUTF-8truefalsefalseNONEfalsefalsesyslog-5424-reader-raw-messageRaw messageIf true, the record will have a _raw field containing the raw messagefalsetruetruefalsefalsetruefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.syslog.SyslogReaderCONTROLLER_SERVICEAttempts to parses the contents of a Syslog message in accordance to RFC5424 and RFC3164. In the case of RFC5424 formatted messages, structured data is not supported, and will be returned as part of the message.Note: Be mindfull that RFC3164 is informational and a wide range of different implementations are present in the wild.sysloglogslogfilesparsetextrecordreaderCharacter SetCharacter SetSpecifies which character set of the Syslog messagesUTF-8truefalsefalseNONEfalsefalsesyslog-5424-reader-raw-messageRaw messageIf true, the record will have a _raw field containing the raw messagefalsetruetruefalsefalsetruefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.text.FreeFormTextRecordSetWriterCONTROLLER_SERVICEWrites the contents of a RecordSet as free-form text. The configured text is able to make use of the Expression Language to reference each of the fields that are available in a Record, as well as the attributes in the FlowFile and variables. If there is a name collision, the field name/value is used before attributes or variables. Each record in the RecordSet will be separated by a single newline character.textfreeformexpressionlanguageelrecordrecordsetresultsetwriterserializeTextTextThe text to use when writing the results. This property will evaluate the Expression Language using any of the fields available in a Record.truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCharacter SetCharacter SetThe Character set to use when writing the data to the FlowFileUTF-8truefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.windowsevent.WindowsEventLogReaderCONTROLLER_SERVICEReads Windows Event Log data as XML content having been generated by ConsumeWindowsEventLog, ParseEvtx, etc. (see Additional Details) and creates Record object(s). If the root tag of the input XML is 'Events', the child content is expected to be a series of 'Event' tags, each of which will constitute a single record. If the root tag is 'Event', the content is expected to be a single 'Event' and thus a single record. No other root tags are valid. Only events of type 'System' are currently supported.xmlwindowseventlogrecordreaderparserorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.xml.XMLReaderCONTROLLER_SERVICEReads XML content and creates Record objects. Records are expected in the second level of XML data, embedded in an enclosing root tag.xmlrecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaUse 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.Infer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerparse_xml_attributesParse XML AttributesWhen 'Schema Access Strategy' is 'Infer Schema' and this property is 'true' then XML attributes are parsed and added to the record as new fields. When the schema is inferred but this property is 'false', XML attributes and their values are ignored.truetruetruefalsefalsefalsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyinfer-schemaschema-inference-cacheSchema Inference CacheSpecifies a Schema Cache to use when inferring the schema. If not populated, the schema will be inferred each time. However, if a cache is specified, the cache will first be consulted and if the applicable schema can be found, it will be used instead of inferring the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalserecord_formatExpect Records as ArrayThis property defines whether the reader expects a FlowFile to consist of a single Record or a series of Records with a "wrapper element". Because XML does not provide for a way to read a series of XML documents from a stream directly, it is common to combine many XML documents by concatenating them and then wrapping the entire XML blob with a "wrapper element". This property dictates whether the reader expects a FlowFile to consist of a single Record or a series of Records with a "wrapper element" that will be ignored.falsefalsefalseEach FlowFile will consist of a single record without any sort of "wrapper".truetrueEach FlowFile will consist of zero or more records. The outer-most XML element is expected to be a "wrapper" and will be ignored.Use attribute 'xml.stream.is.array'${xml.stream.is.array}Whether to treat a FlowFile as a single Record or an array of multiple Records is determined by the value of the 'xml.stream.is.array' attribute. If the value of the attribute is 'true' (case-insensitive), then the XML Reader will treat the FlowFile as a series of Records with the outer element being ignored. If the value of the attribute is 'false' (case-insensitive), then the FlowFile is treated as a single Record and no wrapper element is assumed. If the attribute is missing or its value is anything other than 'true' or 'false', then an Exception will be thrown and no records will be parsed.truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseattribute_prefixAttribute PrefixIf this property is set, the name of attributes will be prepended with a prefix when they are added to a record.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalsecontent_field_nameField Name for ContentIf tags with content (e. g. <field>content</field>) are defined as nested records in the schema, the name of the tag will be used as name for the record and the value of this property will be used as name for the field. If tags with content shall be parsed together with attributes (e. g. <field attribute="123">content</field>), they have to be defined as records. In such a case, the name of the tag will be used as the name for the record and the value of this property will be used as the name for the field holding the original content. The name of the attribute will be used to create a new record field, the content of which will be the value of the attribute. For more information, see the 'Additional Details...' section of the XMLReader controller service's documentation.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.xml.XMLRecordSetWriterCONTROLLER_SERVICEWrites a RecordSet to XML. The records are wrapped by a root tag.xmlresultsetwriterserializerecordrecordsetrowSchema Write StrategySchema Write StrategySpecifies how the schema for a Record should be added to the data.no-schemaDo Not Write Schemano-schemaDo not add any schema-related information to the FlowFile.Set 'schema.name' Attributeschema-nameThe FlowFile will be given an attribute named 'schema.name' and this attribute will indicate the name of the schema in the Schema Registry. Note that ifthe schema for a record is not obtained from a Schema Registry, then no attribute will be added.Set 'avro.schema' Attributefull-schema-attributeThe FlowFile will be given an attribute named 'avro.schema' and this attribute will contain the Avro Schema that describes the records in the FlowFile. The contents of the FlowFile need not be Avro, but the text of the schema will be used.Schema Reference Writerschema-reference-writerThe schema reference information will be written through a configured Schema Reference Writer service implementation.truefalsefalseNONEfalsefalseschema-cacheSchema CacheSpecifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseSchema Reference WriterSchema Reference WriterService implementation responsible for writing FlowFile attributes or content header with Schema reference informationorg.apache.nifi.schemaregistry.services.SchemaReferenceWriterorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseSchema Write StrategySchema Write Strategyschema-reference-writerschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.inherit-record-schemaInherit Record Schemainherit-record-schemaThe schema used to write records will be the same schema that was given to the Record when the Record was created.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalsesuppress_nullsSuppress Null ValuesSpecifies how the writer should handle a null fieldnever-suppressNever Suppressnever-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will be written out as a null valueAlways Suppressalways-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will not be written outSuppress Missing Valuessuppress-missingWhen a field has a value of null, it will be written out. However, if a field is defined in the schema and not present in the record, the field will not be written out.truefalsefalseNONEfalsefalsepretty_print_xmlPretty Print XMLSpecifies whether or not the XML should be pretty printedfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseomit_xml_declarationOmit XML DeclarationSpecifies whether or not to include XML declarationfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseroot_tag_nameName of Root TagSpecifies the name of the XML root tag wrapping the record set. This property has to be defined if the writer is supposed to write multiple records in a single FlowFile.falsefalsefalseNONEfalsefalserecord_tag_nameName of Record TagSpecifies the name of the XML record tag wrapping the record fields. If this is not set, the writer will use the record name in the schema.falsefalsefalseNONEfalsefalsearray_wrappingWrap Elements of ArraysSpecifies how the writer wraps elements of fields of type arrayno-wrappingUse Property as Wrapperuse-property-as-wrapperThe value of the property "Array Tag Name" will be used as the tag name to wrap elements of an array. The field name of the array field will be used for the tag name of the elements.Use Property for Elementsuse-property-for-elementsThe value of the property "Array Tag Name" will be used for the tag name of the elements of an array. The field name of the array field will be used as the tag name to wrap elements.No Wrappingno-wrappingThe elements of an array will not be wrappedtruefalsefalseNONEfalsefalsearray_tag_nameArray Tag NameName of the tag used by property "Wrap Elements of Arrays" to write arraysfalsefalsefalseNONEfalsefalseCharacter SetCharacter SetThe Character set to use when writing the data to the FlowFileUTF-8truefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.yaml.YamlTreeReaderCONTROLLER_SERVICEParses YAML into individual Record objects. While the reader expects each record to be well-formed YAML, the content of a FlowFile may consist of many records, each as a well-formed YAML array or YAML object. If an array is encountered, each element in that array will be treated as a separate record. If the schema that is configured contains a field that is not present in the YAML, a null value will be used. If the YAML contains a field that is not present in the schema, that field will be skipped. Please note this controller service does not support resolving the use of YAML aliases. Any alias present will be treated as a string. See the Usage of the Controller Service for more information and examples.yamltreerecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaInfer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-inference-cacheSchema Inference CacheSpecifies a Schema Cache to use when inferring the schema. If not populated, the schema will be inferred each time. However, if a cache is specified, the cache will first be consulted and if the applicable schema can be found, it will be used instead of inferring the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyinfer-schemastarting-field-strategyStarting Field StrategyStart processing from the root node or from a specified nested node.ROOT_NODERoot NodeROOT_NODEBegins processing from the root node.Nested FieldNESTED_FIELDSkips forward to the given nested JSON field (array or object) to begin processing.truefalsefalseNONEfalsefalsestarting-field-nameStarting Field NameSkips forward to the given nested JSON field (array or object) to begin processing.falsefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-application-strategySchema Application StrategySpecifies whether the schema is defined for the whole JSON or for the selected part starting from "Starting Field Name".SELECTED_PARTWhole JSONWHOLE_JSONApplies the schema for the whole JSON.Selected PartSELECTED_PARTApplies the schema for the selected part starting from the "Starting Field Name".truefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-text-propertyDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseorg.apache.nifi.json.JsonPathReaderorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4 \ No newline at end of file +* FastCSV - duplicate headers will be de-duplicated with the field value being that of the left-most duplicate CSV columntruetruetruefalsefalsefalsefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomTrim double quoteTrim double quoteWhether or not to trim starting and ending double quotes. For example: with trim string '"test"' would be parsed to 'test', without trim would be parsed to '"test"'.If set to 'false' it means full compliance with RFC-4180. Default value is true, with trim.truetruetruefalsefalsetruefalsefalseNONEfalsefalseCSV FormatCSV Formatrfc-4180org.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.csv.CSVRecordSetWriterCONTROLLER_SERVICEWrites the contents of a RecordSet as CSV data. The first line written will be the column names (unless the 'Include Header Line' property is false). All subsequent lines will be the values corresponding to the record fields.csvresultsetrecordsetrecordwriterserializerrowtsvtabseparateddelimitedSchema Write StrategySchema Write StrategySpecifies how the schema for a Record should be added to the data.no-schemaDo Not Write Schemano-schemaDo not add any schema-related information to the FlowFile.Set 'schema.name' Attributeschema-nameThe FlowFile will be given an attribute named 'schema.name' and this attribute will indicate the name of the schema in the Schema Registry. Note that ifthe schema for a record is not obtained from a Schema Registry, then no attribute will be added.Set 'avro.schema' Attributefull-schema-attributeThe FlowFile will be given an attribute named 'avro.schema' and this attribute will contain the Avro Schema that describes the records in the FlowFile. The contents of the FlowFile need not be Avro, but the text of the schema will be used.Schema Reference Writerschema-reference-writerThe schema reference information will be written through a configured Schema Reference Writer service implementation.truefalsefalseNONEfalsefalseschema-cacheSchema CacheSpecifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseSchema Reference WriterSchema Reference WriterService implementation responsible for writing FlowFile attributes or content header with Schema reference informationorg.apache.nifi.schemaregistry.services.SchemaReferenceWriterorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseSchema Write StrategySchema Write Strategyschema-reference-writerschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.inherit-record-schemaInherit Record Schemainherit-record-schemaThe schema used to write records will be the same schema that was given to the Record when the Record was created.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseCSV FormatCSV FormatSpecifies which "format" the CSV data is in, or specifies if custom formatting should be used.customCustom FormatcustomThe format of the CSV is configured by using the properties of this Controller Service, such as Value SeparatorRFC 4180rfc-4180CSV data follows the RFC 4180 Specification defined at https://tools.ietf.org/html/rfc4180Microsoft ExcelexcelCSV data follows the format used by Microsoft ExcelTab-DelimitedtdfCSV data is Tab-Delimited instead of Comma DelimitedMySQL FormatmysqlCSV data follows the format used by MySQLInformix Unloadinformix-unloadThe format used by Informix when issuing the UNLOAD TO file_name commandInformix Unload Escape Disabledinformix-unload-csvThe format used by Informix when issuing the UNLOAD TO file_name command with escaping disabledtruefalsefalseNONEfalsefalsecsv-writerCSV WriterSpecifies which writer implementation to use to write CSV records. NOTE: Different writers may support different subsets of functionality and may also exhibit different levels of performance.commons-csvApache Commons CSVcommons-csvThe CSV writer implementation from the Apache Commons CSV library.FastCSVfast-csvThe CSV writer implementation from the FastCSV library. NOTE: This writer only officially supports RFC-4180, so it recommended to set the 'CSV Format' property to 'RFC 4180'. It does handle some non-compliant CSV data, for that case set the 'CSV Format' property to 'CUSTOM' and the other custom format properties (such as 'Trim Fields', 'Trim double quote', etc.) as appropriate. Be aware that this may cause errors if FastCSV doesn't handle the property settings correctly (such as 'Quote Mode'), but otherwise may process the output as expected even if the data is not fully RFC-4180 compliant.truefalsefalseNONEfalsefalseValue SeparatorValue SeparatorThe character that is used to separate values/fields in a CSV Record. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Value Separator at runtime, then it will be skipped and the default Value Separator will be used.,truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomInclude Header LineInclude Header LineSpecifies whether or not the CSV column names should be written out as the first line.truetruetruefalsefalsetruefalsefalseNONEfalsefalseQuote CharacterQuote CharacterThe character that is used to quote values so that escape characters do not have to be used. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Quote Character at runtime, then it will be skipped and the default Quote Character will be used."truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomEscape CharacterEscape CharacterThe character that is used to escape characters that would otherwise have a specific meaning to the CSV Parser. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Escape Character at runtime, then it will be skipped and the default Escape Character will be used. Setting it to an empty string means no escape character should be used.\truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomComment MarkerComment MarkerThe character that is used to denote the start of a comment. Any line that begins with this comment will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCSV FormatCSV FormatcustomNull StringNull StringSpecifies a String that, if present as a value in the CSV, should be considered a null field instead of using the literal value.falsefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomTrim FieldsTrim FieldsWhether or not white space should be removed from the beginning and end of fieldstruetruetruefalsefalsetruefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomQuote ModeQuote ModeSpecifies how fields should be quoted when they are writtenMINIMALQuote All ValuesALLAll values will be quoted using the configured quote character.Quote MinimalMINIMALValues will be quoted only if they are contain special characters such as newline characters or field separators.Quote Non-Numeric ValuesNON_NUMERICValues will be quoted unless the value is a number.Do Not Quote ValuesNONEValues will not be quoted. Instead, all special characters will be escaped using the configured escape character.truefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomRecord SeparatorRecord SeparatorSpecifies the characters to use in order to separate CSV Records\ntruefalsefalseNONEfalsefalseCSV FormatCSV FormatcustomInclude Trailing DelimiterInclude Trailing DelimiterIf true, a trailing delimiter will be added to each CSV Record that is written. If false, the trailing delimiter will be omitted.falsetruetruefalsefalsetruefalsefalseNONEfalsefalseCSV FormatCSV Formatcustomcsvutils-character-setCharacter SetThe Character Encoding that is used to encode/decode the CSV fileUTF-8truefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.grok.GrokReaderCONTROLLER_SERVICEProvides a mechanism for reading unstructured text data, such as log files, and structuring the data so that it can be processed. The service is configured using Grok patterns. The service reads from a stream of data and splits each message that it finds into a separate Record, each containing the fields that are configured. If a line in the input does not match the expected message pattern, the line of text is either considered to be part of the previous message or is skipped, depending on the configuration, with the exception of stack traces. A stack trace that is found at the end of a log message is considered to be part of the previous message but is added to the 'stackTrace' field of the Record. If a record has no stack trace, it will have a NULL value for the stackTrace field (assuming that the schema does in fact include a stackTrace field of type String). Assuming that the schema includes a '_raw' field of type String, the raw message will be included in the Record.groklogslogfilesparseunstructuredtextrecordreaderregexpatternlogstashschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.string-fields-from-grok-expressionUse String Fields From Grok Expressionstring-fields-from-grok-expressionThe schema will be derived using the field names present in all configured Grok Expressions. All schema fields will have a String type and will be marked as nullable. The schema will also include a `stackTrace` field, and a `_raw` field containing the input line string.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerGrok Pattern FileGrok PatternsGrok Patterns to use for parsing logs. If not specified, a built-in default Pattern file will be used. If specified, all patterns specified will override the default patterns. See the Controller Service's Additional Details for a list of pre-defined patterns.falsefalsetrueENVIRONMENTfalsefalseSINGLEURLFILETEXTGrok ExpressionGrok ExpressionsSpecifies the format of a log line in Grok format. This allows the Record Reader to understand how to parse each log line. The property supports one or more Grok expressions. The Reader attempts to parse input lines according to the configured order of the expressions.If a line in the log file does not match any expressions, the line will be assumed to belong to the previous log message.If other Grok patterns are referenced by this expression, they need to be supplied in the Grok Pattern File property.truefalsefalseNONEfalsefalseSINGLEURLFILETEXTno-match-behaviorNo Match BehaviorIf a line of text is encountered and it does not match the given Grok Expression, and it is not part of a stack trace, this property specifies how the text should be processed.append-to-previous-messageAppend to Previous Messageappend-to-previous-messageThe line of text that does not match the Grok Expression will be appended to the last field of the prior message.Skip Lineskip-lineThe line of text that does not match the Grok Expression will be skipped.Raw Lineraw-lineThe line of text that does not match the Grok Expression will only be added to the _raw field.truefalsefalseNONEfalsefalsereference remote resourcesPatterns and Expressions can reference resources over HTTPorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.json.JsonPathReaderCONTROLLER_SERVICEParses JSON records and evaluates user-defined JSON Path's against each JSON object. While the reader expects each record to be well-formed JSON, the content of a FlowFile may consist of many records, each as a well-formed JSON array or JSON object with optional whitespace between them, such as the common 'JSON-per-line' format. If an array is encountered, each element in that array will be treated as a separate record. User-defined properties define the fields that should be extracted from the JSON in order to form the fields of a Record. Any JSON field that is not extracted via a JSONPath will not be returned in the JSON Records.jsonjsonpathrecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaUse 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.Infer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerMax String LengthMax String LengthThe maximum allowed length of a string value when parsing the JSON document20 MBtruefalsefalseNONEfalsefalseAllow CommentsAllow CommentsWhether to allow comments when parsing the JSON documentfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseThe field name for the record.A JSONPath Expression that will be evaluated against each JSON record. The result of the JSONPath will be the value of the field whose name is the same as the property name.User-defined properties identify how to extract specific fields from a JSON object in order to create a RecordNONEorg.apache.nifi.json.JsonTreeReaderorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.json.JsonRecordSetWriterCONTROLLER_SERVICEWrites the results of a RecordSet as either a JSON Array or one JSON object per line. If using Array output, then even if the RecordSet consists of a single row, it will be written as an array with a single element. If using One Line Per Object output, the JSON objects cannot be pretty-printed.jsonresultsetwriterserializerecordrecordsetrowSchema Write StrategySchema Write StrategySpecifies how the schema for a Record should be added to the data.no-schemaDo Not Write Schemano-schemaDo not add any schema-related information to the FlowFile.Set 'schema.name' Attributeschema-nameThe FlowFile will be given an attribute named 'schema.name' and this attribute will indicate the name of the schema in the Schema Registry. Note that ifthe schema for a record is not obtained from a Schema Registry, then no attribute will be added.Set 'avro.schema' Attributefull-schema-attributeThe FlowFile will be given an attribute named 'avro.schema' and this attribute will contain the Avro Schema that describes the records in the FlowFile. The contents of the FlowFile need not be Avro, but the text of the schema will be used.Schema Reference Writerschema-reference-writerThe schema reference information will be written through a configured Schema Reference Writer service implementation.truefalsefalseNONEfalsefalseschema-cacheSchema CacheSpecifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseSchema Reference WriterSchema Reference WriterService implementation responsible for writing FlowFile attributes or content header with Schema reference informationorg.apache.nifi.schemaregistry.services.SchemaReferenceWriterorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseSchema Write StrategySchema Write Strategyschema-reference-writerschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.inherit-record-schemaInherit Record Schemainherit-record-schemaThe schema used to write records will be the same schema that was given to the Record when the Record was created.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalsePretty Print JSONPretty Print JSONSpecifies whether or not the JSON should be pretty printedfalsetruetruefalsefalsetruefalsefalseNONEfalsefalsesuppress-nullsSuppress Null ValuesSpecifies how the writer should handle a null fieldnever-suppressNever Suppressnever-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will be written out as a null valueAlways Suppressalways-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will not be written outSuppress Missing Valuessuppress-missingWhen a field has a value of null, it will be written out. However, if a field is defined in the schema and not present in the record, the field will not be written out.truefalsefalseNONEfalsefalseAllow Scientific NotationAllow Scientific NotationSpecifies whether or not scientific notation should be used when writing numbersfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseoutput-groupingOutput GroupingSpecifies how the writer should output the JSON records (as an array or one object per line, e.g.) Note that if 'One Line Per Object' is selected, then Pretty Print JSON must be false.output-arrayArrayoutput-arrayOutput records as a JSON arrayOne Line Per Objectoutput-onelineOutput records with one JSON object per line, delimited by a newline charactertruefalsefalseNONEfalsefalsecompression-formatCompression FormatThe compression format to use. Valid values are: GZIP, BZIP2, ZSTD, XZ-LZMA2, LZMA, Snappy, and Snappy Framednonenonenonegzipgzipbzip2bzip2xz-lzma2xz-lzma2snappysnappysnappy framedsnappy framedzstdzstdtruefalsefalseNONEfalsefalsecompression-levelCompression LevelThe compression level to use; this is valid only when using GZIP compression. A lower value results in faster processing but less compression; a value of 0 indicates no compression but simply archiving100112233445566778899truefalsefalseNONEfalsefalsecompression-formatCompression Formatgziporg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.json.JsonTreeReaderCONTROLLER_SERVICEParses JSON into individual Record objects. While the reader expects each record to be well-formed JSON, the content of a FlowFile may consist of many records, each as a well-formed JSON array or JSON object with optional whitespace between them, such as the common 'JSON-per-line' format. If an array is encountered, each element in that array will be treated as a separate record. If the schema that is configured contains a field that is not present in the JSON, a null value will be used. If the JSON contains a field that is not present in the schema, that field will be skipped. See the Usage of the Controller Service for more information and examples.jsontreerecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaInfer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-inference-cacheSchema Inference CacheSpecifies a Schema Cache to use when inferring the schema. If not populated, the schema will be inferred each time. However, if a cache is specified, the cache will first be consulted and if the applicable schema can be found, it will be used instead of inferring the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyinfer-schemastarting-field-strategyStarting Field StrategyStart processing from the root node or from a specified nested node.ROOT_NODERoot NodeROOT_NODEBegins processing from the root node.Nested FieldNESTED_FIELDSkips forward to the given nested JSON field (array or object) to begin processing.truefalsefalseNONEfalsefalsestarting-field-nameStarting Field NameSkips forward to the given nested JSON field (array or object) to begin processing.falsefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-application-strategySchema Application StrategySpecifies whether the schema is defined for the whole JSON or for the selected part starting from "Starting Field Name".SELECTED_PARTWhole JSONWHOLE_JSONApplies the schema for the whole JSON.Selected PartSELECTED_PARTApplies the schema for the selected part starting from the "Starting Field Name".truefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-text-propertyMax String LengthMax String LengthThe maximum allowed length of a string value when parsing the JSON document20 MBtruefalsefalseNONEfalsefalseAllow CommentsAllow CommentsWhether to allow comments when parsing the JSON documentfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseorg.apache.nifi.json.JsonPathReaderorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.lookup.ReaderLookupCONTROLLER_SERVICEProvides a RecordReaderFactory that can be used to dynamically select another RecordReaderFactory. This will allow multiple RecordReaderFactories to be defined and registered, and then selected dynamically at runtime by referencing a FlowFile attribute in the Service to Use property.lookupparserecordrowreaderService to UseService to UseSpecifies the name of the user-defined property whose associated Controller Service should be used.${recordreader.name}truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseName of the RecordReaderA RecordReaderFactory controller serviceNONEorg.apache.nifi.lookup.RecordSetWriterLookuporg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.lookup.RecordSetWriterLookupCONTROLLER_SERVICEProvides a RecordSetWriterFactory that can be used to dynamically select another RecordSetWriterFactory. This will allow multiple RecordSetWriterFactory's to be defined and registered, and then selected dynamically at runtime by tagging FlowFiles with the attributes and referencing those attributes in the Service to Use property.lookupresultsetwriterserializerrecordrecordsetrowService to UseService to UseSpecifies the name of the user-defined property whose associated Controller Service should be used.${recordsetwriter.name}truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseName of the RecordSetWriterA RecordSetWriterFactory controller serviceNONEorg.apache.nifi.lookup.ReaderLookuporg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.schema.inference.VolatileSchemaCacheCONTROLLER_SERVICEProvides a Schema Cache that evicts elements based on a Least-Recently-Used algorithm. This cache is not persisted, so any restart of NiFi will result in the cache being cleared. Additionally, the cache will be cleared any time that the Controller Service is stopped and restarted.recordschemacachemax-cache-sizeMaximum Cache SizeThe maximum number of Schemas to cache.100truefalsetrueENVIRONMENTfalsefalseorg.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.syslog.Syslog5424ReaderCONTROLLER_SERVICEProvides a mechanism for reading RFC 5424 compliant Syslog data, such as log files, and structuring the data so that it can be processed.syslog 5424sysloglogslogfilesparsetextrecordreaderCharacter SetCharacter SetSpecifies which character set of the Syslog messagesUTF-8truefalsefalseNONEfalsefalsesyslog-5424-reader-raw-messageRaw messageIf true, the record will have a _raw field containing the raw messagefalsetruetruefalsefalsetruefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.syslog.SyslogReaderCONTROLLER_SERVICEAttempts to parses the contents of a Syslog message in accordance to RFC5424 and RFC3164. In the case of RFC5424 formatted messages, structured data is not supported, and will be returned as part of the message.Note: Be mindfull that RFC3164 is informational and a wide range of different implementations are present in the wild.sysloglogslogfilesparsetextrecordreaderCharacter SetCharacter SetSpecifies which character set of the Syslog messagesUTF-8truefalsefalseNONEfalsefalsesyslog-5424-reader-raw-messageRaw messageIf true, the record will have a _raw field containing the raw messagefalsetruetruefalsefalsetruefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.text.FreeFormTextRecordSetWriterCONTROLLER_SERVICEWrites the contents of a RecordSet as free-form text. The configured text is able to make use of the Expression Language to reference each of the fields that are available in a Record, as well as the attributes in the FlowFile and variables. If there is a name collision, the field name/value is used before attributes or variables. Each record in the RecordSet will be separated by a single newline character.textfreeformexpressionlanguageelrecordrecordsetresultsetwriterserializeTextTextThe text to use when writing the results. This property will evaluate the Expression Language using any of the fields available in a Record.truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseCharacter SetCharacter SetThe Character set to use when writing the data to the FlowFileUTF-8truefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.windowsevent.WindowsEventLogReaderCONTROLLER_SERVICEReads Windows Event Log data as XML content having been generated by ConsumeWindowsEventLog, ParseEvtx, etc. (see Additional Details) and creates Record object(s). If the root tag of the input XML is 'Events', the child content is expected to be a series of 'Event' tags, each of which will constitute a single record. If the root tag is 'Event', the content is expected to be a single 'Event' and thus a single record. No other root tags are valid. Only events of type 'System' are currently supported.xmlwindowseventlogrecordreaderparserorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.xml.XMLReaderCONTROLLER_SERVICEReads XML content and creates Record objects. Records are expected in the second level of XML data, embedded in an enclosing root tag.xmlrecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaUse 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.Infer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerparse_xml_attributesParse XML AttributesWhen 'Schema Access Strategy' is 'Infer Schema' and this property is 'true' then XML attributes are parsed and added to the record as new fields. When the schema is inferred but this property is 'false', XML attributes and their values are ignored.truetruetruefalsefalsefalsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyinfer-schemaschema-inference-cacheSchema Inference CacheSpecifies a Schema Cache to use when inferring the schema. If not populated, the schema will be inferred each time. However, if a cache is specified, the cache will first be consulted and if the applicable schema can be found, it will be used instead of inferring the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalserecord_formatExpect Records as ArrayThis property defines whether the reader expects a FlowFile to consist of a single Record or a series of Records with a "wrapper element". Because XML does not provide for a way to read a series of XML documents from a stream directly, it is common to combine many XML documents by concatenating them and then wrapping the entire XML blob with a "wrapper element". This property dictates whether the reader expects a FlowFile to consist of a single Record or a series of Records with a "wrapper element" that will be ignored.falsefalsefalseEach FlowFile will consist of a single record without any sort of "wrapper".truetrueEach FlowFile will consist of zero or more records. The outer-most XML element is expected to be a "wrapper" and will be ignored.Use attribute 'xml.stream.is.array'${xml.stream.is.array}Whether to treat a FlowFile as a single Record or an array of multiple Records is determined by the value of the 'xml.stream.is.array' attribute. If the value of the attribute is 'true' (case-insensitive), then the XML Reader will treat the FlowFile as a series of Records with the outer element being ignored. If the value of the attribute is 'false' (case-insensitive), then the FlowFile is treated as a single Record and no wrapper element is assumed. If the attribute is missing or its value is anything other than 'true' or 'false', then an Exception will be thrown and no records will be parsed.truefalsetrueFLOWFILE_ATTRIBUTESfalsefalseattribute_prefixAttribute PrefixIf this property is set, the name of attributes will be prepended with a prefix when they are added to a record.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalsecontent_field_nameField Name for ContentIf tags with content (e. g. <field>content</field>) are defined as nested records in the schema, the name of the tag will be used as name for the record and the value of this property will be used as name for the field. If tags with content shall be parsed together with attributes (e. g. <field attribute="123">content</field>), they have to be defined as records. In such a case, the name of the tag will be used as the name for the record and the value of this property will be used as the name for the field holding the original content. The name of the attribute will be used to create a new record field, the content of which will be the value of the attribute. For more information, see the 'Additional Details...' section of the XMLReader controller service's documentation.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.xml.XMLRecordSetWriterCONTROLLER_SERVICEWrites a RecordSet to XML. The records are wrapped by a root tag.xmlresultsetwriterserializerecordrecordsetrowSchema Write StrategySchema Write StrategySpecifies how the schema for a Record should be added to the data.no-schemaDo Not Write Schemano-schemaDo not add any schema-related information to the FlowFile.Set 'schema.name' Attributeschema-nameThe FlowFile will be given an attribute named 'schema.name' and this attribute will indicate the name of the schema in the Schema Registry. Note that ifthe schema for a record is not obtained from a Schema Registry, then no attribute will be added.Set 'avro.schema' Attributefull-schema-attributeThe FlowFile will be given an attribute named 'avro.schema' and this attribute will contain the Avro Schema that describes the records in the FlowFile. The contents of the FlowFile need not be Avro, but the text of the schema will be used.Schema Reference Writerschema-reference-writerThe schema reference information will be written through a configured Schema Reference Writer service implementation.truefalsefalseNONEfalsefalseschema-cacheSchema CacheSpecifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseSchema Reference WriterSchema Reference WriterService implementation responsible for writing FlowFile attributes or content header with Schema reference informationorg.apache.nifi.schemaregistry.services.SchemaReferenceWriterorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseSchema Write StrategySchema Write Strategyschema-reference-writerschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.inherit-record-schemaInherit Record Schemainherit-record-schemaThe schema used to write records will be the same schema that was given to the Record when the Record was created.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalsesuppress_nullsSuppress Null ValuesSpecifies how the writer should handle a null fieldnever-suppressNever Suppressnever-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will be written out as a null valueAlways Suppressalways-suppressFields that are missing (present in the schema but not in the record), or that have a value of null, will not be written outSuppress Missing Valuessuppress-missingWhen a field has a value of null, it will be written out. However, if a field is defined in the schema and not present in the record, the field will not be written out.truefalsefalseNONEfalsefalsepretty_print_xmlPretty Print XMLSpecifies whether or not the XML should be pretty printedfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseomit_xml_declarationOmit XML DeclarationSpecifies whether or not to include XML declarationfalsetruetruefalsefalsetruefalsefalseNONEfalsefalseroot_tag_nameName of Root TagSpecifies the name of the XML root tag wrapping the record set. This property has to be defined if the writer is supposed to write multiple records in a single FlowFile.falsefalsefalseNONEfalsefalserecord_tag_nameName of Record TagSpecifies the name of the XML record tag wrapping the record fields. If this is not set, the writer will use the record name in the schema.falsefalsefalseNONEfalsefalsearray_wrappingWrap Elements of ArraysSpecifies how the writer wraps elements of fields of type arrayno-wrappingUse Property as Wrapperuse-property-as-wrapperThe value of the property "Array Tag Name" will be used as the tag name to wrap elements of an array. The field name of the array field will be used for the tag name of the elements.Use Property for Elementsuse-property-for-elementsThe value of the property "Array Tag Name" will be used for the tag name of the elements of an array. The field name of the array field will be used as the tag name to wrap elements.No Wrappingno-wrappingThe elements of an array will not be wrappedtruefalsefalseNONEfalsefalsearray_tag_nameArray Tag NameName of the tag used by property "Wrap Elements of Arrays" to write arraysfalsefalsefalseNONEfalsefalseCharacter SetCharacter SetThe Character set to use when writing the data to the FlowFileUTF-8truefalsefalseNONEfalsefalseorg.apache.nifi.serialization.RecordSetWriterFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4org.apache.nifi.yaml.YamlTreeReaderCONTROLLER_SERVICEParses YAML into individual Record objects. While the reader expects each record to be well-formed YAML, the content of a FlowFile may consist of many records, each as a well-formed YAML array or YAML object. If an array is encountered, each element in that array will be treated as a separate record. If the schema that is configured contains a field that is not present in the YAML, a null value will be used. If the YAML contains a field that is not present in the schema, that field will be skipped. Please note this controller service does not support resolving the use of YAML aliases. Any alias present will be treated as a string. See the Usage of the Controller Service for more information and examples.yamltreerecordreaderparserschema-access-strategySchema Access StrategySpecifies how to obtain the schema that is to be used for interpreting the data.infer-schemaInfer Schemainfer-schemaThe Schema of the data will be inferred automatically when the data is read. See component Usage and Additional Details for information about how the schema is inferred.Use 'Schema Name' Propertyschema-nameThe name of the Schema to use is specified by the 'Schema Name' Property. The value of this property is used to lookup the Schema in the configured Schema Registry service.Use 'Schema Text' Propertyschema-text-propertyThe text of the Schema itself is specified by the 'Schema Text' Property. The value of this property must be a valid Avro Schema. If Expression Language is used, the value of the 'Schema Text' property must be valid after substituting the expressions.Schema Reference Readerschema-reference-readerThe schema reference information will be provided through a configured Schema Reference Reader service implementation.truefalsefalseNONEfalsefalseschema-registrySchema RegistrySpecifies the Controller Service to use for the Schema Registryorg.apache.nifi.schemaregistry.services.SchemaRegistryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-nameSchema NameSpecifies the name of the schema to lookup in the Schema Registry property${schema.name}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-versionSchema VersionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-branchSchema BranchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-nameschema-textSchema TextThe text of an Avro-formatted Schema${avro.schema}falsefalsetrueFLOWFILE_ATTRIBUTESfalsefalseschema-access-strategySchema Access Strategyschema-text-propertyschema-reference-readerSchema Reference ReaderService implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifierorg.apache.nifi.schemaregistry.services.SchemaReferenceReaderorg.apache.nifinifi-standard-services-api-nar2.0.0-M4truefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyschema-reference-readerschema-inference-cacheSchema Inference CacheSpecifies a Schema Cache to use when inferring the schema. If not populated, the schema will be inferred each time. However, if a cache is specified, the cache will first be consulted and if the applicable schema can be found, it will be used instead of inferring the schema.org.apache.nifi.serialization.RecordSchemaCacheServiceorg.apache.nifinifi-standard-services-api-nar2.0.0-M4falsefalsefalseNONEfalsefalseschema-access-strategySchema Access Strategyinfer-schemastarting-field-strategyStarting Field StrategyStart processing from the root node or from a specified nested node.ROOT_NODERoot NodeROOT_NODEBegins processing from the root node.Nested FieldNESTED_FIELDSkips forward to the given nested JSON field (array or object) to begin processing.truefalsefalseNONEfalsefalsestarting-field-nameStarting Field NameSkips forward to the given nested JSON field (array or object) to begin processing.falsefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-application-strategySchema Application StrategySpecifies whether the schema is defined for the whole JSON or for the selected part starting from "Starting Field Name".SELECTED_PARTWhole JSONWHOLE_JSONApplies the schema for the whole JSON.Selected PartSELECTED_PARTApplies the schema for the selected part starting from the "Starting Field Name".truefalsefalseNONEfalsefalsestarting-field-strategyStarting Field StrategyNESTED_FIELDschema-access-strategySchema Access Strategyschema-reference-readerschema-nameschema-text-propertyDate FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).falsefalsefalseNONEfalsefalseTime FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).falsefalsefalseNONEfalsefalseTimestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java Simple Date Format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).falsefalsefalseNONEfalsefalseorg.apache.nifi.json.JsonPathReaderorg.apache.nifi.serialization.RecordReaderFactoryorg.apache.nifinifi-standard-services-api-nar2.0.0-M4 \ No newline at end of file