@Generated(value="software.amazon.awssdk:codegen") public final class DevEndpoint extends Object implements SdkPojo, Serializable, ToCopyableBuilder<DevEndpoint.Builder,DevEndpoint>
A development endpoint where a developer can remotely debug extract, transform, and load (ETL) scripts.
| Modifier and Type | Class and Description |
|---|---|
static interface |
DevEndpoint.Builder |
| Modifier and Type | Method and Description |
|---|---|
Map<String,String> |
arguments()
A map of arguments used to configure the
DevEndpoint. |
String |
availabilityZone()
The AWS Availability Zone where this
DevEndpoint is located. |
static DevEndpoint.Builder |
builder() |
Instant |
createdTimestamp()
The point in time at which this DevEndpoint was created.
|
String |
endpointName()
The name of the
DevEndpoint. |
boolean |
equals(Object obj) |
boolean |
equalsBySdkFields(Object obj) |
String |
extraJarsS3Path()
The path to one or more Java
.jar files in an S3 bucket that should be loaded in your
DevEndpoint. |
String |
extraPythonLibsS3Path()
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your
DevEndpoint. |
String |
failureReason()
The reason for a current failure in this
DevEndpoint. |
<T> Optional<T> |
getValueForField(String fieldName,
Class<T> clazz) |
String |
glueVersion()
Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
|
boolean |
hasArguments()
Returns true if the Arguments property was specified by the sender (it may be empty), or false if the sender did
not specify the value (it will be empty).
|
int |
hashCode() |
boolean |
hasPublicKeys()
Returns true if the PublicKeys property was specified by the sender (it may be empty), or false if the sender did
not specify the value (it will be empty).
|
boolean |
hasSecurityGroupIds()
Returns true if the SecurityGroupIds property was specified by the sender (it may be empty), or false if the
sender did not specify the value (it will be empty).
|
Instant |
lastModifiedTimestamp()
The point in time at which this
DevEndpoint was last modified. |
String |
lastUpdateStatus()
The status of the last update.
|
Integer |
numberOfNodes()
The number of AWS Glue Data Processing Units (DPUs) allocated to this
DevEndpoint. |
Integer |
numberOfWorkers()
The number of workers of a defined
workerType that are allocated to the development endpoint. |
String |
privateAddress()
A private IP address to access the
DevEndpoint within a VPC if the DevEndpoint is
created within one. |
String |
publicAddress()
The public IP address used by this
DevEndpoint. |
String |
publicKey()
The public key to be used by this
DevEndpoint for authentication. |
List<String> |
publicKeys()
A list of public keys to be used by the
DevEndpoints for authentication. |
String |
roleArn()
The Amazon Resource Name (ARN) of the IAM role used in this
DevEndpoint. |
List<SdkField<?>> |
sdkFields() |
String |
securityConfiguration()
The name of the
SecurityConfiguration structure to be used with this DevEndpoint. |
List<String> |
securityGroupIds()
A list of security group identifiers used in this
DevEndpoint. |
static Class<? extends DevEndpoint.Builder> |
serializableBuilderClass() |
String |
status()
The current status of this
DevEndpoint. |
String |
subnetId()
The subnet ID for this
DevEndpoint. |
DevEndpoint.Builder |
toBuilder() |
String |
toString()
Returns a string representation of this object.
|
String |
vpcId()
The ID of the virtual private cloud (VPC) used by this
DevEndpoint. |
WorkerType |
workerType()
The type of predefined worker that is allocated to the development endpoint.
|
String |
workerTypeAsString()
The type of predefined worker that is allocated to the development endpoint.
|
String |
yarnEndpointAddress()
The YARN endpoint address used by this
DevEndpoint. |
Integer |
zeppelinRemoteSparkInterpreterPort()
The Apache Zeppelin port for the remote Apache Spark interpreter.
|
clone, finalize, getClass, notify, notifyAll, wait, wait, waitcopypublic String endpointName()
The name of the DevEndpoint.
DevEndpoint.public String roleArn()
The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.
DevEndpoint.public boolean hasSecurityGroupIds()
public List<String> securityGroupIds()
A list of security group identifiers used in this DevEndpoint.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
You can use hasSecurityGroupIds() to see if a value was sent in this field.
DevEndpoint.public String subnetId()
The subnet ID for this DevEndpoint.
DevEndpoint.public String yarnEndpointAddress()
The YARN endpoint address used by this DevEndpoint.
DevEndpoint.public String privateAddress()
A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is
created within one. The PrivateAddress field is present only when you create the
DevEndpoint within your VPC.
DevEndpoint within a VPC if the DevEndpoint
is created within one. The PrivateAddress field is present only when you create the
DevEndpoint within your VPC.public Integer zeppelinRemoteSparkInterpreterPort()
The Apache Zeppelin port for the remote Apache Spark interpreter.
public String publicAddress()
The public IP address used by this DevEndpoint. The PublicAddress field is present only
when you create a non-virtual private cloud (VPC) DevEndpoint.
DevEndpoint. The PublicAddress field is
present only when you create a non-virtual private cloud (VPC) DevEndpoint.public String status()
The current status of this DevEndpoint.
DevEndpoint.public WorkerType workerType()
The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2
executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB
disk.
If the service returns an enum value that is not available in the current SDK version, workerType will
return WorkerType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from
workerTypeAsString().
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk,
and 2 executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a
64 GB disk.
WorkerTypepublic String workerTypeAsString()
The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2
executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB
disk.
If the service returns an enum value that is not available in the current SDK version, workerType will
return WorkerType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from
workerTypeAsString().
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk,
and 2 executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a
64 GB disk.
WorkerTypepublic String glueVersion()
Glue version determines the versions of Apache Spark and Python that AWS Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.
For more information about the available AWS Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are
provided, the version defaults to Python 2.
For more information about the available AWS Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments
are provided, the version defaults to Python 2.
public Integer numberOfWorkers()
The number of workers of a defined workerType that are allocated to the development endpoint.
The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.
workerType that are allocated to the development
endpoint.
The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.
public Integer numberOfNodes()
The number of AWS Glue Data Processing Units (DPUs) allocated to this DevEndpoint.
DevEndpoint.public String availabilityZone()
The AWS Availability Zone where this DevEndpoint is located.
DevEndpoint is located.public String vpcId()
The ID of the virtual private cloud (VPC) used by this DevEndpoint.
DevEndpoint.public String extraPythonLibsS3Path()
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your
DevEndpoint. Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such
as the pandas Python data analysis library, are not currently supported.
DevEndpoint. Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C
extensions, such as the pandas Python data analysis library, are
not currently supported.
public String extraJarsS3Path()
The path to one or more Java .jar files in an S3 bucket that should be loaded in your
DevEndpoint.
You can only use pure Java/Scala libraries with a DevEndpoint.
.jar files in an S3 bucket that should be loaded in your
DevEndpoint.
You can only use pure Java/Scala libraries with a DevEndpoint.
public String failureReason()
The reason for a current failure in this DevEndpoint.
DevEndpoint.public String lastUpdateStatus()
The status of the last update.
public Instant createdTimestamp()
The point in time at which this DevEndpoint was created.
public Instant lastModifiedTimestamp()
The point in time at which this DevEndpoint was last modified.
DevEndpoint was last modified.public String publicKey()
The public key to be used by this DevEndpoint for authentication. This attribute is provided for
backward compatibility because the recommended attribute to use is public keys.
DevEndpoint for authentication. This attribute is provided
for backward compatibility because the recommended attribute to use is public keys.public boolean hasPublicKeys()
public List<String> publicKeys()
A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is
preferred over a single public key because the public keys allow you to have a different private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a list of
public keys. Call the UpdateDevEndpoint API operation with the public key content in the
deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
You can use hasPublicKeys() to see if a value was sent in this field.
DevEndpoints for authentication. Using this
attribute is preferred over a single public key because the public keys allow you to have a different
private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a
list of public keys. Call the UpdateDevEndpoint API operation with the public key content in
the deletePublicKeys attribute, and the list of new keys in the addPublicKeys
attribute.
public String securityConfiguration()
The name of the SecurityConfiguration structure to be used with this DevEndpoint.
SecurityConfiguration structure to be used with this
DevEndpoint.public boolean hasArguments()
public Map<String,String> arguments()
A map of arguments used to configure the DevEndpoint.
Valid arguments are:
"--enable-glue-datacatalog": ""
"GLUE_PYTHON_VERSION": "3"
"GLUE_PYTHON_VERSION": "2"
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are
provided, the version defaults to Python 2.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
You can use hasArguments() to see if a value was sent in this field.
DevEndpoint.
Valid arguments are:
"--enable-glue-datacatalog": ""
"GLUE_PYTHON_VERSION": "3"
"GLUE_PYTHON_VERSION": "2"
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments
are provided, the version defaults to Python 2.
public DevEndpoint.Builder toBuilder()
toBuilder in interface ToCopyableBuilder<DevEndpoint.Builder,DevEndpoint>public static DevEndpoint.Builder builder()
public static Class<? extends DevEndpoint.Builder> serializableBuilderClass()
public boolean equalsBySdkFields(Object obj)
equalsBySdkFields in interface SdkPojopublic String toString()
Copyright © 2020. All rights reserved.