2019/02/13 - Amazon Elastic File System - 2 new 3 updated api methods
Changes Customers can now use the EFS Infrequent Access (IA) storage class to more cost-effectively store larger amounts of data in their file systems. EFS IA is cost-optimized storage for files that are not accessed every day. You can create a new file system and enable Lifecycle Management to automatically move files that have not been accessed for 30 days from the Standard storage class to the IA storage class.
Returns the current LifecycleConfiguration object for the specified Amazon EFS file system. EFS lifecycle management uses the LifecycleConfiguration to identify which files to move to the EFS Infrequent Access (IA) storage class. For a file system without a LifecycleConfiguration , the call returns an empty array in the response.
This operation requires permissions for the elasticfilesystem:DescribeLifecycleConfiguration operation.
See also: AWS API Documentation
Request Syntax
client.describe_lifecycle_configuration(
FileSystemId='string'
)
string
[REQUIRED]
The ID of the file system whose LifecycleConfiguration object you want to retrieve (String).
dict
Response Syntax
{
'LifecyclePolicies': [
{
'TransitionToIA': 'AFTER_30_DAYS'
},
]
}
Response Structure
(dict) --
LifecyclePolicies (list) --
An array of lifecycle management policies. Currently, EFS supports a maximum of one policy per file system.
(dict) --
Describes a policy used by EFS lifecycle management to transition files to the Infrequent Access (IA) storage class.
TransitionToIA (string) --
A value that indicates how long it takes to transition to the IA storage class. Currently, the only possible value is AFTER_30_DAYS .
AFTER_30_DAYS indicates files that have not been read from or written to for 30 days are transitioned from the Standard storage class to the IA storage class. Metadata operations such as listing the contents of a directory don't count as a file access event.
Enables lifecycle management by creating a new LifecycleConfiguration object. A LifecycleConfiguration defines when files in an Amazon EFS file system are automatically transitioned to the lower-cost EFS Infrequent Access (IA) storage class. A LifecycleConfiguration applies to all files in a file system.
Each Amazon EFS file system supports one lifecycle configuration, which applies to all files in the file system. If a LifecycleConfiguration already exists for the specified file system, a PutLifecycleConfiguration call modifies the existing configuration. A PutLifecycleConfiguration call with an empty LifecyclePolicies array in the request body deletes any existing LifecycleConfiguration and disables lifecycle management.
Note
You can enable lifecycle management only for EFS file systems created after the release of EFS infrequent access.
In the request, specify the following:
The ID for the file system for which you are creating a lifecycle management configuration.
A LifecyclePolicies array of LifecyclePolicy objects that define when files are moved to the IA storage class. The array can contain only one "TransitionToIA": "AFTER_30_DAYS" LifecyclePolicy object.
This operation requires permissions for the elasticfilesystem:PutLifecycleConfiguration operation.
To apply a LifecycleConfiguration object to an encrypted file system, you need the same AWS Key Management Service (AWS KMS) permissions as when you created the encrypted file system.
See also: AWS API Documentation
Request Syntax
client.put_lifecycle_configuration(
FileSystemId='string',
LifecyclePolicies=[
{
'TransitionToIA': 'AFTER_30_DAYS'
},
]
)
string
[REQUIRED]
The ID of the file system for which you are creating the LifecycleConfiguration object (String).
list
[REQUIRED]
An array of LifecyclePolicy objects that define the file system's LifecycleConfiguration object. A LifecycleConfiguration object tells lifecycle management when to transition files from the Standard storage class to the Infrequent Access storage class.
(dict) --
Describes a policy used by EFS lifecycle management to transition files to the Infrequent Access (IA) storage class.
TransitionToIA (string) --
A value that indicates how long it takes to transition to the IA storage class. Currently, the only possible value is AFTER_30_DAYS .
AFTER_30_DAYS indicates files that have not been read from or written to for 30 days are transitioned from the Standard storage class to the IA storage class. Metadata operations such as listing the contents of a directory don't count as a file access event.
dict
Response Syntax
{
'LifecyclePolicies': [
{
'TransitionToIA': 'AFTER_30_DAYS'
},
]
}
Response Structure
(dict) --
LifecyclePolicies (list) --
An array of lifecycle management policies. Currently, EFS supports a maximum of one policy per file system.
(dict) --
Describes a policy used by EFS lifecycle management to transition files to the Infrequent Access (IA) storage class.
TransitionToIA (string) --
A value that indicates how long it takes to transition to the IA storage class. Currently, the only possible value is AFTER_30_DAYS .
AFTER_30_DAYS indicates files that have not been read from or written to for 30 days are transitioned from the Standard storage class to the IA storage class. Metadata operations such as listing the contents of a directory don't count as a file access event.
{'SizeInBytes': {'ValueInIA': 'long', 'ValueInStandard': 'long'}}
Creates a new, empty file system. The operation requires a creation token in the request that Amazon EFS uses to ensure idempotent creation (calling the operation with same creation token has no effect). If a file system does not currently exist that is owned by the caller's AWS account with the specified creation token, this operation does the following:
Creates a new, empty file system. The file system will have an Amazon EFS assigned ID, and an initial lifecycle state creating .
Returns with the description of the created file system.
Otherwise, this operation returns a FileSystemAlreadyExists error with the ID of the existing file system.
Note
For basic use cases, you can use a randomly generated UUID for the creation token.
The idempotent operation allows you to retry a CreateFileSystem call without risk of creating an extra file system. This can happen when an initial call fails in a way that leaves it uncertain whether or not a file system was actually created. An example might be that a transport level timeout occurred or your connection was reset. As long as you use the same creation token, if the initial call had succeeded in creating a file system, the client can learn of its existence from the FileSystemAlreadyExists error.
Note
The CreateFileSystem call returns while the file system's lifecycle state is still creating . You can check the file system creation status by calling the DescribeFileSystems operation, which among other things returns the file system state.
This operation also takes an optional PerformanceMode parameter that you choose for your file system. We recommend generalPurpose performance mode for most file systems. File systems using the maxIO performance mode can scale to higher levels of aggregate throughput and operations per second with a tradeoff of slightly higher latencies for most file operations. The performance mode can't be changed after the file system has been created. For more information, see Amazon EFS: Performance Modes.
After the file system is fully created, Amazon EFS sets its lifecycle state to available , at which point you can create one or more mount targets for the file system in your VPC. For more information, see CreateMountTarget. You mount your Amazon EFS file system on an EC2 instances in your VPC by using the mount target. For more information, see Amazon EFS: How it Works.
This operation requires permissions for the elasticfilesystem:CreateFileSystem action.
See also: AWS API Documentation
Request Syntax
client.create_file_system(
CreationToken='string',
PerformanceMode='generalPurpose'|'maxIO',
Encrypted=True|False,
KmsKeyId='string',
ThroughputMode='bursting'|'provisioned',
ProvisionedThroughputInMibps=123.0
)
string
[REQUIRED]
String of up to 64 ASCII characters. Amazon EFS uses this to ensure idempotent creation.
string
The PerformanceMode of the file system. We recommend generalPurpose performance mode for most file systems. File systems using the maxIO performance mode can scale to higher levels of aggregate throughput and operations per second with a tradeoff of slightly higher latencies for most file operations. This can't be changed after the file system has been created.
boolean
A Boolean value that, if true, creates an encrypted file system. When creating an encrypted file system, you have the option of specifying a CreateFileSystemRequest$KmsKeyId for an existing AWS Key Management Service (AWS KMS) customer master key (CMK). If you don't specify a CMK, then the default CMK for Amazon EFS, /aws/elasticfilesystem , is used to protect the encrypted file system.
string
The ID of the AWS KMS CMK to be used to protect the encrypted file system. This parameter is only required if you want to use a non-default CMK. If this parameter is not specified, the default CMK for Amazon EFS is used. This ID can be in one of the following formats:
Key ID - A unique identifier of the key, for example, 1234abcd-12ab-34cd-56ef-1234567890ab .
ARN - An Amazon Resource Name (ARN) for the key, for example, arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab .
Key alias - A previously created display name for a key. For example, alias/projectKey1 .
Key alias ARN - An ARN for a key alias, for example, arn:aws:kms:us-west-2:444455556666:alias/projectKey1 .
If KmsKeyId is specified, the CreateFileSystemRequest$Encrypted parameter must be set to true.
string
The throughput mode for the file system to be created. There are two throughput modes to choose from for your file system: bursting and provisioned. You can decrease your file system's throughput in Provisioned Throughput mode or change between the throughput modes as long as it’s been more than 24 hours since the last decrease or throughput mode change.
float
The throughput, measured in MiB/s, that you want to provision for a file system that you're creating. The limit on throughput is 1024 MiB/s. You can get these limits increased by contacting AWS Support. For more information, see Amazon EFS Limits That You Can Increase in the Amazon EFS User Guide.
dict
Response Syntax
{
'OwnerId': 'string',
'CreationToken': 'string',
'FileSystemId': 'string',
'CreationTime': datetime(2015, 1, 1),
'LifeCycleState': 'creating'|'available'|'updating'|'deleting'|'deleted',
'Name': 'string',
'NumberOfMountTargets': 123,
'SizeInBytes': {
'Value': 123,
'Timestamp': datetime(2015, 1, 1),
'ValueInIA': 123,
'ValueInStandard': 123
},
'PerformanceMode': 'generalPurpose'|'maxIO',
'Encrypted': True|False,
'KmsKeyId': 'string',
'ThroughputMode': 'bursting'|'provisioned',
'ProvisionedThroughputInMibps': 123.0
}
Response Structure
(dict) --
Description of the file system.
OwnerId (string) --
AWS account that created the file system. If the file system was created by an IAM user, the parent account to which the user belongs is the owner.
CreationToken (string) --
Opaque string specified in the request.
FileSystemId (string) --
ID of the file system, assigned by Amazon EFS.
CreationTime (datetime) --
Time that the file system was created, in seconds (since 1970-01-01T00:00:00Z).
LifeCycleState (string) --
Lifecycle phase of the file system.
Name (string) --
You can add tags to a file system, including a Name tag. For more information, see CreateTags. If the file system has a Name tag, Amazon EFS returns the value in this field.
NumberOfMountTargets (integer) --
Current number of mount targets that the file system has. For more information, see CreateMountTarget.
SizeInBytes (dict) --
Latest known metered size (in bytes) of data stored in the file system, in its Value field, and the time at which that size was determined in its Timestamp field. The Timestamp value is the integer number of seconds since 1970-01-01T00:00:00Z. The SizeInBytes value doesn't represent the size of a consistent snapshot of the file system, but it is eventually consistent when there are no writes to the file system. That is, SizeInBytes represents actual size only if the file system is not modified for a period longer than a couple of hours. Otherwise, the value is not the exact size that the file system was at any point in time.
Value (integer) --
Latest known metered size (in bytes) of data stored in the file system.
Timestamp (datetime) --
Time at which the size of data, returned in the Value field, was determined. The value is the integer number of seconds since 1970-01-01T00:00:00Z.
ValueInIA (integer) --
The latest known metered size (in bytes) of data stored in the Infrequent Access storage class.
ValueInStandard (integer) --
The latest known metered size (in bytes) of data stored in the Standard storage class.
PerformanceMode (string) --
The PerformanceMode of the file system.
Encrypted (boolean) --
A Boolean value that, if true, indicates that the file system is encrypted.
KmsKeyId (string) --
The ID of an AWS Key Management Service (AWS KMS) customer master key (CMK) that was used to protect the encrypted file system.
ThroughputMode (string) --
The throughput mode for a file system. There are two throughput modes to choose from for your file system: bursting and provisioned. You can decrease your file system's throughput in Provisioned Throughput mode or change between the throughput modes as long as it’s been more than 24 hours since the last decrease or throughput mode change.
ProvisionedThroughputInMibps (float) --
The throughput, measured in MiB/s, that you want to provision for a file system. The limit on throughput is 1024 MiB/s. You can get these limits increased by contacting AWS Support. For more information, see Amazon EFS Limits That You Can Increase in the Amazon EFS User Guide.
{'FileSystems': {'SizeInBytes': {'ValueInIA': 'long',
'ValueInStandard': 'long'}}}
Returns the description of a specific Amazon EFS file system if either the file system CreationToken or the FileSystemId is provided. Otherwise, it returns descriptions of all file systems owned by the caller's AWS account in the AWS Region of the endpoint that you're calling.
When retrieving all file system descriptions, you can optionally specify the MaxItems parameter to limit the number of descriptions in a response. Currently, this number is automatically set to 10. If more file system descriptions remain, Amazon EFS returns a NextMarker , an opaque token, in the response. In this case, you should send a subsequent request with the Marker request parameter set to the value of NextMarker .
To retrieve a list of your file system descriptions, this operation is used in an iterative process, where DescribeFileSystems is called first without the Marker and then the operation continues to call it with the Marker parameter set to the value of the NextMarker from the previous response until the response has no NextMarker .
The order of file systems returned in the response of one DescribeFileSystems call and the order of file systems returned across the responses of a multi-call iteration is unspecified.
This operation requires permissions for the elasticfilesystem:DescribeFileSystems action.
See also: AWS API Documentation
Request Syntax
client.describe_file_systems(
MaxItems=123,
Marker='string',
CreationToken='string',
FileSystemId='string'
)
integer
(Optional) Specifies the maximum number of file systems to return in the response (integer). Currently, this number is automatically set to 10.
string
(Optional) Opaque pagination token returned from a previous DescribeFileSystems operation (String). If present, specifies to continue the list from where the returning call had left off.
string
(Optional) Restricts the list to the file system with this creation token (String). You specify a creation token when you create an Amazon EFS file system.
string
(Optional) ID of the file system whose description you want to retrieve (String).
dict
Response Syntax
{
'Marker': 'string',
'FileSystems': [
{
'OwnerId': 'string',
'CreationToken': 'string',
'FileSystemId': 'string',
'CreationTime': datetime(2015, 1, 1),
'LifeCycleState': 'creating'|'available'|'updating'|'deleting'|'deleted',
'Name': 'string',
'NumberOfMountTargets': 123,
'SizeInBytes': {
'Value': 123,
'Timestamp': datetime(2015, 1, 1),
'ValueInIA': 123,
'ValueInStandard': 123
},
'PerformanceMode': 'generalPurpose'|'maxIO',
'Encrypted': True|False,
'KmsKeyId': 'string',
'ThroughputMode': 'bursting'|'provisioned',
'ProvisionedThroughputInMibps': 123.0
},
],
'NextMarker': 'string'
}
Response Structure
(dict) --
Marker (string) --
Present if provided by caller in the request (String).
FileSystems (list) --
Array of file system descriptions.
(dict) --
Description of the file system.
OwnerId (string) --
AWS account that created the file system. If the file system was created by an IAM user, the parent account to which the user belongs is the owner.
CreationToken (string) --
Opaque string specified in the request.
FileSystemId (string) --
ID of the file system, assigned by Amazon EFS.
CreationTime (datetime) --
Time that the file system was created, in seconds (since 1970-01-01T00:00:00Z).
LifeCycleState (string) --
Lifecycle phase of the file system.
Name (string) --
You can add tags to a file system, including a Name tag. For more information, see CreateTags. If the file system has a Name tag, Amazon EFS returns the value in this field.
NumberOfMountTargets (integer) --
Current number of mount targets that the file system has. For more information, see CreateMountTarget.
SizeInBytes (dict) --
Latest known metered size (in bytes) of data stored in the file system, in its Value field, and the time at which that size was determined in its Timestamp field. The Timestamp value is the integer number of seconds since 1970-01-01T00:00:00Z. The SizeInBytes value doesn't represent the size of a consistent snapshot of the file system, but it is eventually consistent when there are no writes to the file system. That is, SizeInBytes represents actual size only if the file system is not modified for a period longer than a couple of hours. Otherwise, the value is not the exact size that the file system was at any point in time.
Value (integer) --
Latest known metered size (in bytes) of data stored in the file system.
Timestamp (datetime) --
Time at which the size of data, returned in the Value field, was determined. The value is the integer number of seconds since 1970-01-01T00:00:00Z.
ValueInIA (integer) --
The latest known metered size (in bytes) of data stored in the Infrequent Access storage class.
ValueInStandard (integer) --
The latest known metered size (in bytes) of data stored in the Standard storage class.
PerformanceMode (string) --
The PerformanceMode of the file system.
Encrypted (boolean) --
A Boolean value that, if true, indicates that the file system is encrypted.
KmsKeyId (string) --
The ID of an AWS Key Management Service (AWS KMS) customer master key (CMK) that was used to protect the encrypted file system.
ThroughputMode (string) --
The throughput mode for a file system. There are two throughput modes to choose from for your file system: bursting and provisioned. You can decrease your file system's throughput in Provisioned Throughput mode or change between the throughput modes as long as it’s been more than 24 hours since the last decrease or throughput mode change.
ProvisionedThroughputInMibps (float) --
The throughput, measured in MiB/s, that you want to provision for a file system. The limit on throughput is 1024 MiB/s. You can get these limits increased by contacting AWS Support. For more information, see Amazon EFS Limits That You Can Increase in the Amazon EFS User Guide.
NextMarker (string) --
Present if there are more file systems than returned in the response (String). You can use the NextMarker in the subsequent request to fetch the descriptions.
{'SizeInBytes': {'ValueInIA': 'long', 'ValueInStandard': 'long'}}
Updates the throughput mode or the amount of provisioned throughput of an existing file system.
See also: AWS API Documentation
Request Syntax
client.update_file_system(
FileSystemId='string',
ThroughputMode='bursting'|'provisioned',
ProvisionedThroughputInMibps=123.0
)
string
[REQUIRED]
The ID of the file system that you want to update.
string
(Optional) The throughput mode that you want your file system to use. If you're not updating your throughput mode, you don't need to provide this value in your request.
float
(Optional) The amount of throughput, in MiB/s, that you want to provision for your file system. If you're not updating the amount of provisioned throughput for your file system, you don't need to provide this value in your request.
dict
Response Syntax
{
'OwnerId': 'string',
'CreationToken': 'string',
'FileSystemId': 'string',
'CreationTime': datetime(2015, 1, 1),
'LifeCycleState': 'creating'|'available'|'updating'|'deleting'|'deleted',
'Name': 'string',
'NumberOfMountTargets': 123,
'SizeInBytes': {
'Value': 123,
'Timestamp': datetime(2015, 1, 1),
'ValueInIA': 123,
'ValueInStandard': 123
},
'PerformanceMode': 'generalPurpose'|'maxIO',
'Encrypted': True|False,
'KmsKeyId': 'string',
'ThroughputMode': 'bursting'|'provisioned',
'ProvisionedThroughputInMibps': 123.0
}
Response Structure
(dict) --
Description of the file system.
OwnerId (string) --
AWS account that created the file system. If the file system was created by an IAM user, the parent account to which the user belongs is the owner.
CreationToken (string) --
Opaque string specified in the request.
FileSystemId (string) --
ID of the file system, assigned by Amazon EFS.
CreationTime (datetime) --
Time that the file system was created, in seconds (since 1970-01-01T00:00:00Z).
LifeCycleState (string) --
Lifecycle phase of the file system.
Name (string) --
You can add tags to a file system, including a Name tag. For more information, see CreateTags. If the file system has a Name tag, Amazon EFS returns the value in this field.
NumberOfMountTargets (integer) --
Current number of mount targets that the file system has. For more information, see CreateMountTarget.
SizeInBytes (dict) --
Latest known metered size (in bytes) of data stored in the file system, in its Value field, and the time at which that size was determined in its Timestamp field. The Timestamp value is the integer number of seconds since 1970-01-01T00:00:00Z. The SizeInBytes value doesn't represent the size of a consistent snapshot of the file system, but it is eventually consistent when there are no writes to the file system. That is, SizeInBytes represents actual size only if the file system is not modified for a period longer than a couple of hours. Otherwise, the value is not the exact size that the file system was at any point in time.
Value (integer) --
Latest known metered size (in bytes) of data stored in the file system.
Timestamp (datetime) --
Time at which the size of data, returned in the Value field, was determined. The value is the integer number of seconds since 1970-01-01T00:00:00Z.
ValueInIA (integer) --
The latest known metered size (in bytes) of data stored in the Infrequent Access storage class.
ValueInStandard (integer) --
The latest known metered size (in bytes) of data stored in the Standard storage class.
PerformanceMode (string) --
The PerformanceMode of the file system.
Encrypted (boolean) --
A Boolean value that, if true, indicates that the file system is encrypted.
KmsKeyId (string) --
The ID of an AWS Key Management Service (AWS KMS) customer master key (CMK) that was used to protect the encrypted file system.
ThroughputMode (string) --
The throughput mode for a file system. There are two throughput modes to choose from for your file system: bursting and provisioned. You can decrease your file system's throughput in Provisioned Throughput mode or change between the throughput modes as long as it’s been more than 24 hours since the last decrease or throughput mode change.
ProvisionedThroughputInMibps (float) --
The throughput, measured in MiB/s, that you want to provision for a file system. The limit on throughput is 1024 MiB/s. You can get these limits increased by contacting AWS Support. For more information, see Amazon EFS Limits That You Can Increase in the Amazon EFS User Guide.