oci.DataFlow.Application

ApplicationLogConfig ApplicationApplicationLogConfig

(Updatable) The number of executor VMs requested.

SparkVersion string

(Updatable) The Spark version utilized to run the application.

(Updatable) Logging details of Application logs for Data Flow Run.

ArchiveUri string

(Updatable) A comma separated list of one or more archive files as Oracle Cloud Infrastructure URIs. For example, oci://path/to/a.zip,oci://path/to/b.zip. An Oracle Cloud Infrastructure URI of an archive.zip file containing custom dependencies that may be used to support the execution of a Python, Java, or Scala application. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Arguments List<string>

(Updatable) The arguments passed to the running application as command line arguments. An argument is either a plain text or a placeholder. Placeholders are replaced using values from the parameters map. Each placeholder specified must be represented in the parameters map else the request (POST or PUT) will fail with a HTTP 400 status code. Placeholders are specified as Service Api Spec, where name is the name of the parameter. Example: [ "--input", "${input_file}", "--name", "John Doe" ] If "input_file" has a value of "mydata.xml", then the value above will be translated to --input mydata.xml --name "John Doe"

ClassName string

(Updatable) The class for the application.

Configuration Dictionary<string, string>

(Updatable) The Spark configuration passed to the running process. See https://spark.apache.org/docs/latest/configuration.html#available-properties. Example: { "spark.app.name" : "My App Name", "spark.shuffle.io.maxRetries" : "4" } Note: Not all Spark properties are permitted to be set. Attempting to set a property that is not allowed to be overwritten will cause a 400 status to be returned.

DefinedTags Dictionary<string, string>

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

Description string

(Updatable) A user-friendly description. Avoid entering confidential information.

DriverShapeConfig ApplicationDriverShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

Execute string

(Updatable) The input used for spark-submit command. For more details see https://spark.apache.org/docs/latest/submitting-applications.html#launching-applications-with-spark-submit. Supported options include --class, --file, --jars, --conf, --py-files, and main application file with arguments. Example:

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

Note: If execute is specified together with applicationId, className, configuration, fileUri, language, arguments, parameters during application create/update, or run create/submit, Data Flow service will use derived information from execute input only.

ExecutorShapeConfig ApplicationExecutorShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

FileUri string

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

FreeformTags Dictionary<string, string>

(Updatable) Free-form tags for this resource. Each tag is a simple key-value pair with no predefined name, type, or namespace. For more information, see Resource Tags. Example: {"Department": "Finance"}

(Updatable) The timeout value in minutes used to manage Runs. A Run would be stopped after inactivity for this amount of time period. Note: This parameter is currently only applicable for Runs of type SESSION. Default value is 2880 minutes (2 days)

LogsBucketUri string

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Parameters List<ApplicationParameter>

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

MetastoreId string

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

(Updatable) An array of name/value pairs used to fill placeholders found in properties like Application.arguments. The name must be a string of one or more word characters (a-z, A-Z, 0-9, _). The value can be a string of 0 or more characters of any kind. Example: [ { name: "iterations", value: "10"}, { name: "input_file", value: "mydata.xml" }, { name: "variable_x", value: "${x}"} ]

PoolId string

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

Type string

The Spark application processing type.

(Updatable) An Oracle Cloud Infrastructure URI of the bucket to be used as default warehouse directory for BATCH SQL runs. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

CompartmentId string

(Updatable) The OCID of a compartment.

DisplayName string

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

DriverShape string

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

ExecutorShape string

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

Language string

(Updatable) The Spark language.

ApplicationLogConfig ApplicationApplicationLogConfigArgs

(Updatable) The number of executor VMs requested.

SparkVersion string

(Updatable) The Spark version utilized to run the application.

(Updatable) Logging details of Application logs for Data Flow Run.

ArchiveUri string

Arguments []string

ClassName string

(Updatable) The class for the application.

Configuration map[string]string

DefinedTags map[string]string

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

Description string

(Updatable) A user-friendly description. Avoid entering confidential information.

DriverShapeConfig ApplicationDriverShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

Execute string

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

ExecutorShapeConfig ApplicationExecutorShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

FileUri string

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

FreeformTags map[string]string

LogsBucketUri string

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

Parameters []ApplicationParameterArgs

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

MetastoreId string

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

PoolId string

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

Type string

The Spark application processing type.

applicationLogConfig ApplicationApplicationLogConfig

compartmentId String

(Updatable) The OCID of a compartment.

displayName String

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driverShape String

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

executorShape String

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

language String

(Updatable) The Spark language.

numExecutors Integer

(Updatable) The number of executor VMs requested.

sparkVersion String

(Updatable) The Spark version utilized to run the application.

(Updatable) Logging details of Application logs for Data Flow Run.

archiveUri String

arguments List<String>

className String

(Updatable) The class for the application.

configuration Map<String,String>

definedTags Map<String,String>

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description String

(Updatable) A user-friendly description. Avoid entering confidential information.

executorShapeConfig ApplicationExecutorShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute String

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

fileUri String

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeformTags Map<String,String>

logsBucketUri String

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

parameters List<ApplicationParameter>

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastoreId String

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

poolId String

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

type String

The Spark application processing type.

applicationLogConfig ApplicationApplicationLogConfig

compartmentId string

(Updatable) The OCID of a compartment.

displayName string

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driverShape string

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

executorShape string

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

language string

(Updatable) The Spark language.

numExecutors number

(Updatable) The number of executor VMs requested.

sparkVersion string

(Updatable) The Spark version utilized to run the application.

(Updatable) Logging details of Application logs for Data Flow Run.

archiveUri string

arguments string[]

className string

(Updatable) The class for the application.

configuration {[key: string]: string}

definedTags {[key: string]: string}

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description string

(Updatable) A user-friendly description. Avoid entering confidential information.

executorShapeConfig ApplicationExecutorShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute string

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

fileUri string

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeformTags {[key: string]: string}

idleTimeoutInMinutes string

logsBucketUri string

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

maxDurationInMinutes string

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastoreId string

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

parameters ApplicationParameter[]

poolId string

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

privateEndpointId string

(Updatable) The OCID of a private endpoint.

terminateRunsOnDeletion boolean

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

type string

The Spark application processing type.

warehouseBucketUri string

compartment_id str

(Updatable) The OCID of a compartment.

display_name str

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driver_shape str

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

executor_shape str

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

language str

(Updatable) The Spark language.

num_executors int

(Updatable) The number of executor VMs requested.

spark_version str

(Updatable) The Spark version utilized to run the application.

application_log_config ApplicationApplicationLogConfigArgs

(Updatable) Logging details of Application logs for Data Flow Run.

archive_uri str

arguments Sequence[str]

class_name str

(Updatable) The class for the application.

configuration Mapping[str, str]

defined_tags Mapping[str, str]

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description str

(Updatable) A user-friendly description. Avoid entering confidential information.

driver_shape_config ApplicationDriverShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute str

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

executor_shape_config ApplicationExecutorShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

file_uri str

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeform_tags Mapping[str, str]

idle_timeout_in_minutes str

logs_bucket_uri str

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

max_duration_in_minutes str

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastore_id str

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

parameters Sequence[ApplicationParameterArgs]

pool_id str

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

private_endpoint_id str

(Updatable) The OCID of a private endpoint.

terminate_runs_on_deletion bool

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

type str

The Spark application processing type.

warehouse_bucket_uri str

compartmentId String

(Updatable) The OCID of a compartment.

displayName String

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driverShape String

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

executorShape String

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

language String

(Updatable) The Spark language.

numExecutors Number

(Updatable) The number of executor VMs requested.

sparkVersion String

(Updatable) The Spark version utilized to run the application.

applicationLogConfig Property Map

(Updatable) Logging details of Application logs for Data Flow Run.

archiveUri String

arguments List<String>

className String

(Updatable) The class for the application.

configuration Map<String>

definedTags Map<String>

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description String

(Updatable) A user-friendly description. Avoid entering confidential information.

driverShapeConfig Property Map

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute String

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

executorShapeConfig Property Map

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

fileUri String

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeformTags Map<String>

logsBucketUri String

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

parameters List<Property Map>

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastoreId String

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

poolId String

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

type String

The Spark application processing type.

ApplicationLogConfig ApplicationApplicationLogConfig

Outputs

All input properties are implicitly available as output properties. Additionally, the Application resource produces the following output properties:

Id string: The provider-assigned unique ID for this managed resource.
OwnerPrincipalId string: The OCID of the user who created the resource.
OwnerUserName string: The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.
State string: The current state of this application.
TimeCreated string: The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z
TimeUpdated string: The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

Id string: The provider-assigned unique ID for this managed resource.
OwnerPrincipalId string: The OCID of the user who created the resource.
OwnerUserName string: The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.
State string: The current state of this application.
TimeCreated string: The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z
TimeUpdated string: The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

id String: The provider-assigned unique ID for this managed resource.
ownerPrincipalId String: The OCID of the user who created the resource.
ownerUserName String: The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.
state String: The current state of this application.
timeCreated String: The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z
timeUpdated String: The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

id string: The provider-assigned unique ID for this managed resource.
ownerPrincipalId string: The OCID of the user who created the resource.
ownerUserName string: The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.
state string: The current state of this application.
timeCreated string: The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z
timeUpdated string: The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

id str: The provider-assigned unique ID for this managed resource.
owner_principal_id str: The OCID of the user who created the resource.
owner_user_name str: The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.
state str: The current state of this application.
time_created str: The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z
time_updated str: The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

id String: The provider-assigned unique ID for this managed resource.
ownerPrincipalId String: The OCID of the user who created the resource.
ownerUserName String: The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.
state String: The current state of this application.
timeCreated String: The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z
timeUpdated String: The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

Look up Existing Application Resource

Get an existing Application resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

public static get(name: string, id: Input<ID>, state?: ApplicationState, opts?: CustomResourceOptions): Application

@staticmethod
def get(resource_name: str,
        id: str,
        opts: Optional[ResourceOptions] = None,
        application_log_config: Optional[ApplicationApplicationLogConfigArgs] = None,
        archive_uri: Optional[str] = None,
        arguments: Optional[Sequence[str]] = None,
        class_name: Optional[str] = None,
        compartment_id: Optional[str] = None,
        configuration: Optional[Mapping[str, str]] = None,
        defined_tags: Optional[Mapping[str, str]] = None,
        description: Optional[str] = None,
        display_name: Optional[str] = None,
        driver_shape: Optional[str] = None,
        driver_shape_config: Optional[ApplicationDriverShapeConfigArgs] = None,
        execute: Optional[str] = None,
        executor_shape: Optional[str] = None,
        executor_shape_config: Optional[ApplicationExecutorShapeConfigArgs] = None,
        file_uri: Optional[str] = None,
        freeform_tags: Optional[Mapping[str, str]] = None,
        idle_timeout_in_minutes: Optional[str] = None,
        language: Optional[str] = None,
        logs_bucket_uri: Optional[str] = None,
        max_duration_in_minutes: Optional[str] = None,
        metastore_id: Optional[str] = None,
        num_executors: Optional[int] = None,
        owner_principal_id: Optional[str] = None,
        owner_user_name: Optional[str] = None,
        parameters: Optional[Sequence[ApplicationParameterArgs]] = None,
        pool_id: Optional[str] = None,
        private_endpoint_id: Optional[str] = None,
        spark_version: Optional[str] = None,
        state: Optional[str] = None,
        terminate_runs_on_deletion: Optional[bool] = None,
        time_created: Optional[str] = None,
        time_updated: Optional[str] = None,
        type: Optional[str] = None,
        warehouse_bucket_uri: Optional[str] = None) -> Application

func GetApplication(ctx *Context, name string, id IDInput, state *ApplicationState, opts ...ResourceOption) (*Application, error)

public static Application Get(string name, Input<string> id, ApplicationState? state, CustomResourceOptions? opts = null)

public static Application get(String name, Output<String> id, ApplicationState state, CustomResourceOptions options)

resources:  _:    type: oci:DataFlow:Application    get:      id: ${id}

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

resource_name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

The following state arguments are supported:

(Updatable) Logging details of Application logs for Data Flow Run.

ArchiveUri string

Arguments List<string>

ClassName string

(Updatable) The class for the application.

CompartmentId string

(Updatable) The OCID of a compartment.

Configuration Dictionary<string, string>

DefinedTags Dictionary<string, string>

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

Description string

(Updatable) A user-friendly description. Avoid entering confidential information.

DisplayName string

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

DriverShape string

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

DriverShapeConfig ApplicationDriverShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

Execute string

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

ExecutorShape string

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

ExecutorShapeConfig ApplicationExecutorShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

FileUri string

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

FreeformTags Dictionary<string, string>

Language string

(Updatable) The Spark language.

LogsBucketUri string

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

MetastoreId string

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

Parameters List<ApplicationParameter>

(Updatable) The number of executor VMs requested.

OwnerPrincipalId string

The OCID of the user who created the resource.

OwnerUserName string

The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.

PoolId string

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

SparkVersion string

(Updatable) The Spark version utilized to run the application.

State string

The current state of this application.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

TimeCreated string

The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

TimeUpdated string

The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

Type string

The Spark application processing type.

ApplicationLogConfig ApplicationApplicationLogConfigArgs

(Updatable) Logging details of Application logs for Data Flow Run.

ArchiveUri string

Arguments []string

ClassName string

(Updatable) The class for the application.

CompartmentId string

(Updatable) The OCID of a compartment.

Configuration map[string]string

DefinedTags map[string]string

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

Description string

(Updatable) A user-friendly description. Avoid entering confidential information.

DisplayName string

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

DriverShape string

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

DriverShapeConfig ApplicationDriverShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

Execute string

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

ExecutorShape string

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

ExecutorShapeConfig ApplicationExecutorShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

FileUri string

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

FreeformTags map[string]string

Language string

(Updatable) The Spark language.

LogsBucketUri string

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

MetastoreId string

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

Parameters []ApplicationParameterArgs

(Updatable) The number of executor VMs requested.

OwnerPrincipalId string

The OCID of the user who created the resource.

OwnerUserName string

The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.

PoolId string

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

SparkVersion string

(Updatable) The Spark version utilized to run the application.

State string

The current state of this application.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

TimeCreated string

The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

TimeUpdated string

The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

Type string

The Spark application processing type.

applicationLogConfig ApplicationApplicationLogConfig

(Updatable) Logging details of Application logs for Data Flow Run.

archiveUri String

arguments List<String>

className String

(Updatable) The class for the application.

compartmentId String

(Updatable) The OCID of a compartment.

configuration Map<String,String>

definedTags Map<String,String>

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description String

(Updatable) A user-friendly description. Avoid entering confidential information.

displayName String

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driverShape String

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

executorShapeConfig ApplicationExecutorShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute String

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

executorShape String

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

fileUri String

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeformTags Map<String,String>

language String

(Updatable) The Spark language.

logsBucketUri String

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

parameters List<ApplicationParameter>

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastoreId String

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

numExecutors Integer

(Updatable) The number of executor VMs requested.

ownerPrincipalId String

The OCID of the user who created the resource.

ownerUserName String

The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.

poolId String

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

sparkVersion String

(Updatable) The Spark version utilized to run the application.

state String

The current state of this application.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

timeCreated String

The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

timeUpdated String

The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

type String

The Spark application processing type.

applicationLogConfig ApplicationApplicationLogConfig

(Updatable) Logging details of Application logs for Data Flow Run.

archiveUri string

arguments string[]

className string

(Updatable) The class for the application.

compartmentId string

(Updatable) The OCID of a compartment.

configuration {[key: string]: string}

definedTags {[key: string]: string}

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description string

(Updatable) A user-friendly description. Avoid entering confidential information.

displayName string

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driverShape string

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

executorShapeConfig ApplicationExecutorShapeConfig

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute string

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

executorShape string

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

fileUri string

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeformTags {[key: string]: string}

idleTimeoutInMinutes string

language string

(Updatable) The Spark language.

logsBucketUri string

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

maxDurationInMinutes string

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastoreId string

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

numExecutors number

(Updatable) The number of executor VMs requested.

ownerPrincipalId string

The OCID of the user who created the resource.

ownerUserName string

The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.

parameters ApplicationParameter[]

poolId string

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

privateEndpointId string

(Updatable) The OCID of a private endpoint.

sparkVersion string

(Updatable) The Spark version utilized to run the application.

state string

The current state of this application.

terminateRunsOnDeletion boolean

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

timeCreated string

The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

timeUpdated string

The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

type string

The Spark application processing type.

warehouseBucketUri string

application_log_config ApplicationApplicationLogConfigArgs

(Updatable) Logging details of Application logs for Data Flow Run.

archive_uri str

arguments Sequence[str]

class_name str

(Updatable) The class for the application.

compartment_id str

(Updatable) The OCID of a compartment.

configuration Mapping[str, str]

defined_tags Mapping[str, str]

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description str

(Updatable) A user-friendly description. Avoid entering confidential information.

display_name str

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driver_shape str

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

driver_shape_config ApplicationDriverShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute str

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

executor_shape str

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

executor_shape_config ApplicationExecutorShapeConfigArgs

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

file_uri str

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeform_tags Mapping[str, str]

idle_timeout_in_minutes str

language str

(Updatable) The Spark language.

logs_bucket_uri str

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

max_duration_in_minutes str

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastore_id str

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

num_executors int

(Updatable) The number of executor VMs requested.

owner_principal_id str

The OCID of the user who created the resource.

owner_user_name str

The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.

parameters Sequence[ApplicationParameterArgs]

pool_id str

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

private_endpoint_id str

(Updatable) The OCID of a private endpoint.

spark_version str

(Updatable) The Spark version utilized to run the application.

state str

The current state of this application.

terminate_runs_on_deletion bool

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

time_created str

The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

time_updated str

The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

type str

The Spark application processing type.

warehouse_bucket_uri str

applicationLogConfig Property Map

(Updatable) Logging details of Application logs for Data Flow Run.

archiveUri String

arguments List<String>

className String

(Updatable) The class for the application.

compartmentId String

(Updatable) The OCID of a compartment.

configuration Map<String>

definedTags Map<String>

(Updatable) Defined tags for this resource. Each key is predefined and scoped to a namespace. For more information, see Resource Tags. Example: {"Operations.CostCenter": "42"}

description String

(Updatable) A user-friendly description. Avoid entering confidential information.

displayName String

(Updatable) A user-friendly name. It does not have to be unique. Avoid entering confidential information.

driverShape String

(Updatable) The VM shape for the driver. Sets the driver cores and memory.

driverShapeConfig Property Map

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

execute String

--jars oci://path/to/a.jar,oci://path/to/b.jar --files oci://path/to/a.json,oci://path/to/b.csv --py-files oci://path/to/a.py,oci://path/to/b.py --conf spark.sql.crossJoin.enabled=true --class org.apache.spark.examples.SparkPi oci://path/to/main.jar 10

executorShape String

(Updatable) The VM shape for the executors. Sets the executor cores and memory.

executorShapeConfig Property Map

(Updatable) This is used to configure the shape of the driver or executor if a flexible shape is used.

fileUri String

(Updatable) An Oracle Cloud Infrastructure URI of the file containing the application to execute. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

freeformTags Map<String>

language String

(Updatable) The Spark language.

logsBucketUri String

(Updatable) An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded. See https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/hdfsconnector.htm#uriformat.

parameters List<Property Map>

(Updatable) The maximum duration in minutes for which an Application should run. Data Flow Run would be terminated once it reaches this duration from the time it transitions to IN_PROGRESS state.

metastoreId String

(Updatable) The OCID of Oracle Cloud Infrastructure Hive Metastore.

numExecutors Number

(Updatable) The number of executor VMs requested.

ownerPrincipalId String

The OCID of the user who created the resource.

ownerUserName String

The username of the user who created the resource. If the username of the owner does not exist, null will be returned and the caller should refer to the ownerPrincipalId value instead.

poolId String

(Updatable) The OCID of a pool. Unique Id to indentify a dataflow pool resource.

(Updatable) The OCID of a private endpoint.

sparkVersion String

(Updatable) The Spark version utilized to run the application.

state String

The current state of this application.

A boolean flag which indicates whether related non-terminal Run(s) for the Application should be terminated along with Application deletion or not.

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

timeCreated String

The date and time the resource was created, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

timeUpdated String

The date and time the resource was updated, expressed in RFC 3339 timestamp format. Example: 2018-04-03T21:10:29.600Z

type String

The Spark application processing type.