@@ -95,25 +95,25 @@ We provide popular built-in transformations that you can apply against your stre
95
95
96
96
### Custom options for data transformations
97
97
98
- Each data transformation class accepts additional options to customize the transformation .
98
+ We will propagate additional options to the underlying implementation for each transform class .
99
99
100
- | Name | Description |
101
- | ----------------- | -------------------------------------------------------------------------------------------------------------- |
102
- | ** GzipTransform** | All the options from the [ GzipFile constructor] ( https://docs.python.org/3/library/gzip.html#gzip.GzipFile ) |
103
- | ** ZipTransform** | All the options from the [ ZipFile constructor] ( https://docs.python.org/3/library/zipfile.html#zipfile.ZipFile ) |
104
- | ** CsvTransform** | All the options from the [ DictReader constructor] ( https://docs.python.org/3/library/csv.html#csv.DictReader ) |
100
+ | Name | Available options |
101
+ | ----------------- | ------------------------------------------------------------------------------------- |
102
+ | ** GzipTransform** | [ GzipFile constructor] ( https://docs.python.org/3/library/gzip.html#gzip.GzipFile ) |
103
+ | ** ZipTransform** | [ ZipFile constructor] ( https://docs.python.org/3/library/zipfile.html#zipfile.ZipFile ) |
104
+ | ** CsvTransform** | [ DictReader constructor] ( https://docs.python.org/3/library/csv.html#csv.DictReader ) |
105
105
106
- For instance, if you want to unzip an S3 object compressed using ` LZMA ` you could pass that option in the constructor:
106
+ For instance, take ` ZipTransform ` . You can use the ` compression ` parameter if you want to unzip an S3 object compressed with ` LZMA ` .
107
107
108
108
=== "Unzipping LZMA data"
109
109
110
110
```python hl_lines="12"
111
111
--8<-- "examples/streaming/src/s3_transform_lzma.py"
112
112
```
113
113
114
- Or, if you want to load a ` TSV ` file, you can just change the delimiter on the ` CSV ` transform :
114
+ Or, if you want to load a tab-separated file (TSV) , you can use the ` delimiter ` parameter in the ` CsvTransform ` :
115
115
116
- === "Loading TSV data"
116
+ === "Deserializing tab-separated data values "
117
117
118
118
```python hl_lines="11"
119
119
--8<-- "examples/streaming/src/s3_transform_tsv.py"
0 commit comments