种子简介

种子名称： [GigaCourse.Com] Udemy - Data Engineering using Databricks on AWS and Azure
文件类型： 视频
文件数目： 178个文件
文件大小： 5.53 GB
收录时间： 2023-1-29 09:36
已经下载： 3次
资源热度： 181
最近下载： 2024-11-27 14:22

下载BT种子文件

下载Torrent文件(.torrent) 立即下载

磁力链接下载

magnet:?xt=urn:btih:2c14bae25dda5035fbc30adf4e7f40c75e918410&dn=[GigaCourse.Com] Udemy - Data Engineering using Databricks on AWS and Azure 复制链接到迅雷、QQ旋风进行下载，或者使用百度云离线下载。

喜欢这个种子的人也喜欢

种子包含的文件

[GigaCourse.Com] Udemy - Data Engineering using Databricks on AWS and Azure.torrent

1. Introduction to Data Engineering using Databricks/1. Overview of the course - Data Engineering using Databricks.mp474.97MB

1. Introduction to Data Engineering using Databricks/3. [Must Watch] 30 Day Money Back Guarantee, Feedback and Rating.mp46.04MB

10. Deploy and Run on Databricks/1. Prepare PyCharm for Databricks.mp438.53MB

10. Deploy and Run on Databricks/10. Get Job and Run Details using Databricks CLI.mp438.71MB

10. Deploy and Run on Databricks/11. Submitting Databricks Jobs using CLI.mp443.21MB

10. Deploy and Run on Databricks/12. Setup and Validate Databricks Client Library.mp447.57MB

10. Deploy and Run on Databricks/13. Resetting the Job using Jobs API.mp445.94MB

10. Deploy and Run on Databricks/14. Run Databricks Job programmatically using Python.mp424.49MB

10. Deploy and Run on Databricks/15. Detailed Validation of Data.mp4101.19MB

10. Deploy and Run on Databricks/2. Prepare Data Sets.mp456.35MB

10. Deploy and Run on Databricks/3. Move files to ghactivity.mp423.27MB

10. Deploy and Run on Databricks/4. Refactor Code for Databricks.mp482.74MB

10. Deploy and Run on Databricks/5. Validating Data using Databricks.mp454.5MB

10. Deploy and Run on Databricks/6. Setup Data Set for Production Deployment.mp422.58MB

10. Deploy and Run on Databricks/7. Access File Metadata using dbutils.mp421.84MB

10. Deploy and Run on Databricks/8. Build Deployable bundle for Databricks.mp424.38MB

10. Deploy and Run on Databricks/9. Running Jobs using Databricks Web UI..mp464.52MB

11. Deploy Jobs using Notebooks/1. Modularizing Notebooks.mp416.55MB

11. Deploy Jobs using Notebooks/2. Running Job using Notebook.mp445.27MB

11. Deploy Jobs using Notebooks/3. Refactor application as Databricks Notebooks.mp420.76MB

11. Deploy Jobs using Notebooks/4. Run Notebook using Development Cluster.mp414.41MB

12. Deep Dive into Delta Lake using Data Frames/1. Introduction to Delta Lake using Data Frames.mp420.82MB

12. Deep Dive into Delta Lake using Data Frames/10. Compaction of Delta Lake Files.mp460.51MB

12. Deep Dive into Delta Lake using Data Frames/2. Creating Data Frames for Delta Lake.mp454.24MB

12. Deep Dive into Delta Lake using Data Frames/3. Writing Data Frame using Delta Format.mp429.71MB

12. Deep Dive into Delta Lake using Data Frames/4. Updating Existing Data using Delta Format.mp452.13MB

12. Deep Dive into Delta Lake using Data Frames/5. Delete Existing Data using Delta Format.mp438.66MB

12. Deep Dive into Delta Lake using Data Frames/6. Merge or Upsert Data using Delta Format.mp474.53MB

12. Deep Dive into Delta Lake using Data Frames/7. Deleting using Merge in Delta Lake.mp466.33MB

12. Deep Dive into Delta Lake using Data Frames/8. Point in Snapshot Recovery using Delta Logs.mp471.28MB

12. Deep Dive into Delta Lake using Data Frames/9. Deleting unnecessary Delta Files using Vacuum.mp475.62MB

13. Deep Dive into Delta Lake using Spark SQL/1. Introduction to Delta Lake using SQL.mp419.35MB

13. Deep Dive into Delta Lake using Spark SQL/10. Vacuuming Delta Lake Tables.mp463.03MB

13. Deep Dive into Delta Lake using Spark SQL/11. Compaction of Delta Lake Tables.mp448.1MB

13. Deep Dive into Delta Lake using Spark SQL/2. Creating Data Frames for Delta Lake.mp454.17MB

13. Deep Dive into Delta Lake using Spark SQL/3. Create Delta Lake Table.mp429.04MB

13. Deep Dive into Delta Lake using Spark SQL/4. Insert Data to Delta Lake Table.mp438.93MB

13. Deep Dive into Delta Lake using Spark SQL/5. Update Data in Delta Lake Table.mp432.29MB

13. Deep Dive into Delta Lake using Spark SQL/6. Delete Data from Delta Lake Table.mp428.89MB

13. Deep Dive into Delta Lake using Spark SQL/7. Merge or Upsert Data into Delta Lake Table.mp450.71MB

13. Deep Dive into Delta Lake using Spark SQL/8. Using Merge Function over Delta Lake Table.mp458.62MB

13. Deep Dive into Delta Lake using Spark SQL/9. Point in Snapshot Recovery using Delta Lake Table.mp463.38MB

14. Accessing Databricks Cluster Terminal via Web as well as SSH/1. Enable Web Terminal in Databricks Admin Console.mp412.14MB

14. Accessing Databricks Cluster Terminal via Web as well as SSH/2. Launch Web Terminal for Databricks Cluster.mp415.15MB

14. Accessing Databricks Cluster Terminal via Web as well as SSH/3. Setup SSH for the Databricks Cluster Driver Node.mp454.29MB

14. Accessing Databricks Cluster Terminal via Web as well as SSH/4. Validate SSH Connectivity to the Databricks Driver Node on AWS.mp441.81MB

14. Accessing Databricks Cluster Terminal via Web as well as SSH/5. Limitations of SSH and comparison with Web Terminal.mp416.4MB

15. Installing Softwares on Databricks Clusters using init scripts/1. Setup gen_logs on Databricks Cluster.mp431.13MB

15. Installing Softwares on Databricks Clusters using init scripts/3. Overview of Init Scripts for Databricks Clusters.mp45.8MB

15. Installing Softwares on Databricks Clusters using init scripts/4. Create Script to install software from git on Databricks Cluster.mp414.2MB

15. Installing Softwares on Databricks Clusters using init scripts/6. Copy init script to dbfs location.mp414.28MB

15. Installing Softwares on Databricks Clusters using init scripts/8. Create Databricks Standalone Cluster with init script.mp432.59MB

16. Quick Recap of Spark Structured Streaming/1. Validate Netcat on Databricks Driver Node.mp448.2MB

16. Quick Recap of Spark Structured Streaming/2. Push log messages to Netcat Webserver on Databricks Driver Node.mp427.89MB

16. Quick Recap of Spark Structured Streaming/3. Reading Web Server logs using Spark Structured Streaming.mp449.43MB

16. Quick Recap of Spark Structured Streaming/4. Writing Streaming Data to Files.mp442.01MB

17. Incremental Loads using Spark Structured Streaming/1. Overview of Spark Structured Streaming.mp411.64MB

17. Incremental Loads using Spark Structured Streaming/10. Validate Incremental Load.mp417.47MB

17. Incremental Loads using Spark Structured Streaming/11. Internals of Spark Structured Streaming File Processing.mp447.25MB

17. Incremental Loads using Spark Structured Streaming/2. Steps for Incremental Data Processing.mp418.95MB

17. Incremental Loads using Spark Structured Streaming/3. Configure Cluster with Instance Profile.mp4.mp437.02MB

17. Incremental Loads using Spark Structured Streaming/4. Upload GHArchive Files to s3.mp448.16MB

17. Incremental Loads using Spark Structured Streaming/5. Read JSON Data using Spark Structured Streaming.mp433.17MB

17. Incremental Loads using Spark Structured Streaming/6. Write using Delta file format using Trigger Once.mp436.06MB

17. Incremental Loads using Spark Structured Streaming/7. Analyze GHArchive Data in Delta files using Spark.mp433.01MB

17. Incremental Loads using Spark Structured Streaming/8. Add New GHActivity JSON files.mp422.53MB

17. Incremental Loads using Spark Structured Streaming/9. Load Data Incrementally to Target Table.mp428.1MB

18. Incremental Loads using Cloud Files/1. Overview of Auto Loader cloudFiles.mp427.2MB

18. Incremental Loads using Cloud Files/10. Review AWS Services for cloudFiles Event Notifications.mp440.1MB

18. Incremental Loads using Cloud Files/11. Review Metadata Generated for cloudFiles Checkpointing.mp463.49MB

18. Incremental Loads using Cloud Files/2. Upload GHArchive Files to s3.mp418.79MB

18. Incremental Loads using Cloud Files/3. Write Data using Auto Loader cloudFiles.mp458.67MB

18. Incremental Loads using Cloud Files/4. Add New GHActivity JSON files.mp415.29MB

18. Incremental Loads using Cloud Files/5. Load Data Incrementally to Target Table.mp439.42MB

18. Incremental Loads using Cloud Files/6. Add New GHActivity JSON files.mp413.11MB

18. Incremental Loads using Cloud Files/7. Overview of Handling S3 Events using AWS Services.mp443.42MB

18. Incremental Loads using Cloud Files/8. Configure IAM Role for cloudFiles file notifications.mp449.03MB

18. Incremental Loads using Cloud Files/9. Incremental Load using cloudFiles File Notifications.mp437.36MB

19. Overview of Databricks SQL Clusters/1. Overview of Databricks SQL Platform - Introduction.mp421.89MB

19. Overview of Databricks SQL Clusters/10. Analyze JSON Data using Spark APIs.mp430.15MB

19. Overview of Databricks SQL Clusters/11. Analyze Delta Table Schemas using Spark APIs.mp419.3MB

19. Overview of Databricks SQL Clusters/12. Load Data from Spark Data Frames into Delta Tables.mp418.7MB

19. Overview of Databricks SQL Clusters/13. Run Adhoc Queries using Databricks SQL Editor to validate data.mp420.75MB

19. Overview of Databricks SQL Clusters/14. Overview of External Tables using Databricks SQL.mp418.45MB

19. Overview of Databricks SQL Clusters/15. Using COPY Command to Copy Data into Delta Tables.mp442.95MB

19. Overview of Databricks SQL Clusters/16. Manage Databricks SQL Endpoints.mp416.37MB

19. Overview of Databricks SQL Clusters/2. Run First Query using SQL Editor of Databricks SQL.mp425.47MB

19. Overview of Databricks SQL Clusters/3. Overview of Dashboards using Databricks SQL.mp412.37MB

19. Overview of Databricks SQL Clusters/4. Overview of Databricks SQL Data Explorer to review Metastore Database and Tables.mp412.54MB

19. Overview of Databricks SQL Clusters/5. Use Databricks SQL Editor to develop scripts or queries.mp425.02MB

19. Overview of Databricks SQL Clusters/6. Review Metadata of Tables using Databricks SQL Platform.mp419.81MB

19. Overview of Databricks SQL Clusters/7. Overview of loading data into retail_db tables.mp45.95MB

19. Overview of Databricks SQL Clusters/8. Configure Databricks CLI to push data into Databricks Platform.mp429.66MB

19. Overview of Databricks SQL Clusters/9. Copy JSON Data into DBFS using Databricks CLI.mp447.96MB

2. Getting Started with Databricks/1. Signing Up For Databricks Community Edition.mp440.34MB

2. Getting Started with Databricks/2. Create Azure Databricks Service.mp439.06MB

2. Getting Started with Databricks/3. Signup For Databricks Full Trial.mp457.63MB

2. Getting Started with Databricks/4. Overview Of Databricks UI.mp49.32MB

2. Getting Started with Databricks/5. Upload Data In Files Into Databricks..mp449.95MB

2. Getting Started with Databricks/6. Create Cluster In Databricks Platform..mp420.42MB

2. Getting Started with Databricks/7. Managing File System Using Notebooks.mp445.04MB

3. Getting Started with Databricks on Azure/1. Getting Started with Databricks on Azure - Introduction.mp47.08MB

3. Getting Started with Databricks on Azure/10. Develop Spark Application using Azure Databricks Notebook.mp441.28MB

3. Getting Started with Databricks on Azure/11. Validate Spark Jobs using Azure Databricks Notebook.mp418.1MB

3. Getting Started with Databricks on Azure/12. Export and Import of Azure Databricks Notebooks.mp415.43MB

3. Getting Started with Databricks on Azure/13. Terminating Azure Databricks Cluster and Deleting Configuration.mp45.9MB

3. Getting Started with Databricks on Azure/14. Delete Azure Databricks Workspace by deleting Resource Group.mp419.15MB

3. Getting Started with Databricks on Azure/2. Signup for the Azure Account.mp410.52MB

3. Getting Started with Databricks on Azure/3. Login and Increase Quotas for regional vCPUs in Azure.mp416.82MB

3. Getting Started with Databricks on Azure/4. Create Azure Databricks Workspace.mp417.1MB

3. Getting Started with Databricks on Azure/5. Launching Azure Databricks Workspace or Cluster.mp48.34MB

3. Getting Started with Databricks on Azure/6. Quick Walkthrough of Azure Databricks UI.mp412.56MB

3. Getting Started with Databricks on Azure/7. Create Azure Databricks Single Node Cluster.mp414.25MB

3. Getting Started with Databricks on Azure/8. Upload Data using Azure Databricks UI.mp424.79MB

3. Getting Started with Databricks on Azure/9. Overview of Creating Notebook and Validating Files.mp418.94MB

4. Azure Essentials for Databricks - Azure CLI/1. Azure Essentials for Databricks - Azure CLI.mp48.58MB

4. Azure Essentials for Databricks - Azure CLI/10. Setup Data Set locally to upload into ADLS File System or Container.mp413.47MB

4. Azure Essentials for Databricks - Azure CLI/11. Upload local directory into Azure ADLS File System or Container.mp460.94MB

4. Azure Essentials for Databricks - Azure CLI/12. Delete Azure ADLS Storage Account using Azure CLI.mp432.96MB

4. Azure Essentials for Databricks - Azure CLI/13. Delete Azure Resource Group using Azure CLI.mp421.47MB

4. Azure Essentials for Databricks - Azure CLI/2. Azure CLI using Azure Portal Cloud Shell.mp413.11MB

4. Azure Essentials for Databricks - Azure CLI/3. Getting Started with Azure CLI on Mac.mp424.75MB

4. Azure Essentials for Databricks - Azure CLI/4. Getting Started with Azure CLI on Windows.mp424.52MB

4. Azure Essentials for Databricks - Azure CLI/5. Warming up with Azure CLI - Overview.mp46.16MB

4. Azure Essentials for Databricks - Azure CLI/6. Create Resource Group using Azure CLI.mp440.75MB

4. Azure Essentials for Databricks - Azure CLI/7. Create ADLS Storage Account with in Resource Group.mp468.01MB

4. Azure Essentials for Databricks - Azure CLI/8. Add Container as part of Storage Account.mp436.17MB

4. Azure Essentials for Databricks - Azure CLI/9. Overview of Uploading the data into ADLS File System or Container.mp411.81MB

5. Mount ADLS on to Azure Databricks/1. Mount ADLS on to Azure Databricks - Introduction.mp417.5MB

5. Mount ADLS on to Azure Databricks/10. Create ADLS Container or File System and Upload Data.mp424.85MB

5. Mount ADLS on to Azure Databricks/11. Start Databricks Cluster to mount ADLS.mp412.3MB

5. Mount ADLS on to Azure Databricks/12. Mount ADLS Storage Account on to Azure Databricks.mp439.31MB

5. Mount ADLS on to Azure Databricks/13. Validate ADLS Mount Point on Azure Databricks Clusters.mp425.09MB

5. Mount ADLS on to Azure Databricks/14. Unmount the mount point from Databricks.mp44.76MB

5. Mount ADLS on to Azure Databricks/15. Delete Azure Resource Group used for Mounting ADLS on to Azure Databricks.mp417.96MB

5. Mount ADLS on to Azure Databricks/2. Ensure Azure Databricks Workspace.mp412.2MB

5. Mount ADLS on to Azure Databricks/3. Setup Databricks CLI on Mac or Windows using Python Virtual Environment.mp415.04MB

5. Mount ADLS on to Azure Databricks/4. Configure Databricks CLI for new Azure Databricks Workspace.mp419.38MB

5. Mount ADLS on to Azure Databricks/5. Register an Azure Active Directory Application.mp423.66MB

5. Mount ADLS on to Azure Databricks/6. Create Databricks Secret for AD Application Client Secret.mp423.39MB

5. Mount ADLS on to Azure Databricks/7. Create ADLS Storage Account.mp424.87MB

5. Mount ADLS on to Azure Databricks/8. Assign IAM Role on Storage Account to Azure AD Application.mp414.36MB

5. Mount ADLS on to Azure Databricks/9. Setup Retail DB Dataset.mp412.37MB

6. Setup Local Development Environment/1. Setup Single Node Databricks Cluster.mp427.57MB

6. Setup Local Development Environment/2. Install Databricks Connect.mp423.93MB

6. Setup Local Development Environment/3. Configure Databricks Connect.mp434.65MB

6. Setup Local Development Environment/4. Integrating Pycharm with Databricks Connect.mp422.21MB

6. Setup Local Development Environment/6. Integrate Databricks Cluster with Glue Catalog.mp471.85MB

6. Setup Local Development Environment/7. Setup s3 Bucket and Grant Permissions.mp422.18MB

6. Setup Local Development Environment/8. Mounting s3 Buckets into Databricks Clusters.mp424.75MB

6. Setup Local Development Environment/9. Using dbutils from IDEs such as Pycharm.mp418.43MB

7. Using Databricks CLI/1. Introduction.mp46.22MB

7. Using Databricks CLI/2. Install and Configure Databricks CLI.mp421.24MB

7. Using Databricks CLI/3. Interacting with File System using CLI..mp470.45MB

7. Using Databricks CLI/4. Getting Cluster Details using CLI.mp436.68MB

8. Spark Application Development Life Cycle/1. Setup Virtual Environment and Install Pyspark.mp437.84MB

8. Spark Application Development Life Cycle/10. Setup Sample Data.mp418.57MB

8. Spark Application Development Life Cycle/11. Read data from files.mp463.61MB

8. Spark Application Development Life Cycle/13. Process data using Spark APIs.mp443.65MB

8. Spark Application Development Life Cycle/15. Write data to files.mp444.71MB

8. Spark Application Development Life Cycle/17. Validating Writing Data to Files.mp450.54MB

8. Spark Application Development Life Cycle/18. Productionizing the Code.mp425.51MB

8. Spark Application Development Life Cycle/20. Setting up Data for Production Validation.mp441.25MB

8. Spark Application Development Life Cycle/3. Getting Started with Pycharm.mp429.73MB

8. Spark Application Development Life Cycle/5. Passing Run Time Arguments.mp429.9MB

8. Spark Application Development Life Cycle/6. Accessing OS Environment Variables.mp423.9MB

8. Spark Application Development Life Cycle/7. Getting Started with Spark.mp418.76MB

8. Spark Application Development Life Cycle/8. Create Function for Spark Session.mp441.28MB

9. Databricks Jobs and Clusters/1. Introduction to Jobs and Clusters.mp415.87MB

9. Databricks Jobs and Clusters/10. Exercise - Submit the application as job using interactive cluster.mp47.49MB

9. Databricks Jobs and Clusters/2. Creating Pools in Databricks Platform.mp419.53MB

9. Databricks Jobs and Clusters/3. Create Cluster on Azure Databricks.mp436.64MB

9. Databricks Jobs and Clusters/4. Request to Increase CPU Quota on Azure.mp421.68MB

9. Databricks Jobs and Clusters/5. Creating Job on Databricks.mp463.86MB

9. Databricks Jobs and Clusters/6. Submitting Jobs using Job Cluster.mp433.37MB

9. Databricks Jobs and Clusters/7. Create Pool in Databricks.mp415.27MB

9. Databricks Jobs and Clusters/8. Running Job using Interactive Cluster Attached to Pool.mp421.52MB

9. Databricks Jobs and Clusters/9. Running Job Using Job Cluster Attached to Pool.mp422.05MB