Posts in 2021
-
Most votes on azure questions 2
May 01, 2021 in FAQ
Most votes on azure questions 2. #11 Checking if a blob exists in Azure Storage #12 Azure SQL Database Bacpac Local Restore #13 Azure table storage returns 400 Bad Request #14 Is there a way to view deployed files in Azure? #15 How can I use NuGet packages in my Azure Functions? #16 In Windows Azure: What are web role, worker role and VM role? #17 Stopping SQL Azure DB when not in use #18 Microsoft Azure: How to create sub directory in a blob container #19 Optimal way to concatenate/aggregate strings #20 Where can I find my Azure account name and account key?
Read all the top votes questions and answers in a single page. #11: Checking if a blob exists in Azure Storage (Score: 138) Created: 2010-04-15 Last updated: 2018-09-21 Tags: c#, azure, azure-blob-storage I’ve got a very simple question (I …
-
Most votes on azure questions 10
May 01, 2021 in FAQ
Most votes on azure questions 10. #91 Use SQL Server Management Studio to connect remotely to an SQL Server Express instance hosted on an Azure Virtual Machine #92 Recommend a C# Task Scheduling Library #93 Comparison between NewRelic and Azure Insights #94 How I add new endpoints to my VM on new azure portal (preview)? #95 Make a file open in browser instead of downloading it #96 Use SVG in Windows Azure Websites #97 Why is Azure deployment slower on Windows 2012 Server than on Windows 2008 Server #98 How to switch accounts via VS Code Azure Account Extension #99 Azure App Service vs Azure Service Fabric #100 Azure Service Fabric vs Azure Container Services
Read all the top votes questions and answers in a single page. #91: Use SQL Server Management Studio to connect remotely to an SQL Server Express instance hosted on an Azure Virtual Machine (Score: 54) Created: 2013-04-11 Last updated: 2017-02-14 …
-
Most votes on azure questions 1
May 01, 2021 in FAQ
Most votes on azure questions 1. #1 What is the difference between an Azure Web Site and an Azure Web Role #2 How to get the azure account tenant Id? #3 Could not load file or assembly "System.Net.Http, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" #4 Azure Webjobs vs Azure Functions : How to choose #5 How do I copy SQL Azure database to my local development server? #6 How do I delete an Azure storage account containing a leased blob? #7 How to re-create database for Entity Framework? #8 Why does Azure deployment take so long? #9 Could not load file or assembly System.Web.Http.WebHost after published to Azure web site #10 Azure Blob Storage vs. File Service
Read all the top votes questions and answers in a single page. #1: What is the difference between an Azure Web Site and an Azure Web Role (Score: 240) Created: 2012-06-08 Last updated: 2015-03-24 Tags: azure, azure-web-roles, azure-web-app-service …
-
Most votes on apache-spark questions 9
May 01, 2021 in FAQ
Most votes on apache-spark questions 9. #81 Removing duplicates from rows based on specific columns in an RDD/Spark DataFrame #82 What is the relationship between workers, worker instances, and executors? #83 How to pivot Spark DataFrame? #84 Is it possible to get the current spark context settings in PySpark? #85 How to find median and quantiles using Spark #86 how to filter out a null value from spark dataframe #87 How to use JDBC source to write and read data in (Py)Spark? #88 Spark code organization and best practices #89 Concatenate two PySpark dataframes #90 How to make good reproducible Apache Spark examples
Read all the top votes questions and answers in a single page. #81: Removing duplicates from rows based on specific columns in an RDD/Spark DataFrame (Score: 74) Created: 2015-05-14 Last updated: 2015-05-15 Tags: apache-spark, apache-spark-sql, …
-
Most votes on apache-spark questions 8
May 01, 2021 in FAQ
Most votes on apache-spark questions 8. #71 How to link PyCharm with PySpark? #72 Updating a dataframe column in spark #73 How to write unit tests in Spark 2.0+? #74 How to prevent java.lang.OutOfMemoryError: PermGen space at Scala compilation? #75 Get current number of partitions of a DataFrame #76 how to make saveAsTextFile NOT split output into multiple file? #77 Which cluster type should I choose for Spark? #78 Split Spark Dataframe string column into multiple columns #79 How to use Column.isin with list? #80 Spark difference between reduceByKey vs groupByKey vs aggregateByKey vs combineByKey
Read all the top votes questions and answers in a single page. #71: How to link PyCharm with PySpark? (Score: 81) Created: 2016-01-08 Last updated: 2019-08-09 Tags: python, apache-spark, pyspark, pycharm, homebrew I’m new with apache spark and …
-
Most votes on apache-spark questions 7
May 01, 2021 in FAQ
Most votes on apache-spark questions 7. #61 What are the benefits of Apache Beam over Spark/Flink for batch processing? #62 At what situation I can use Dask instead of Apache Spark? #63 What is the difference between spark.sql.shuffle.partitions and spark.default.parallelism? #64 How to export a table dataframe in PySpark to csv? #65 Overwrite specific partitions in spark dataframe write method #66 Spark SQL: apply aggregate functions to a list of columns #67 Is there a way to take the first 1000 rows of a Spark Dataframe? #68 How to pass -D parameter or environment variable to Spark job? #69 How does HashPartitioner work? #70 Best way to get the max value in a Spark dataframe column
Read all the top votes questions and answers in a single page. #61: What are the benefits of Apache Beam over Spark/Flink for batch processing? (Score: 86) Created: 2017-04-24 Last updated: 2017-05-23 Tags: apache-spark, apache-flink, apache-beam …
-
Most votes on apache-spark questions 6
May 01, 2021 in FAQ
Most votes on apache-spark questions 6. #51 Why do Spark jobs fail with org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 0 in speculation mode? #52 How to set up Spark on Windows? #53 Mac spark-shell Error initializing SparkContext #54 What does "Stage Skipped" mean in Apache Spark web UI? #55 Spark Dataframe distinguish columns with duplicated name #56 How do I set the driver's python version in spark? #57 Spark Error - Unsupported class file major version #58 How to save DataFrame directly to Hive? #59 How to tune spark executor number, cores and executor memory? #60 Convert pyspark string to date format
Read all the top votes questions and answers in a single page. #51: Why do Spark jobs fail with org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 0 in speculation mode? (Score: 95) Created: 2015-03-06 Last …
-
Most votes on apache-spark questions 5
May 01, 2021 in FAQ
Most votes on apache-spark questions 5. #41 Spark DataFrame groupBy and sort in the descending order (pyspark) #42 How to create an empty DataFrame with a specified schema? #43 What do the numbers on the progress bar mean in spark-shell? #44 Spark - Error "A master URL must be set in your configuration" when submitting an app #45 Can apache spark run without hadoop? #46 How to delete columns in pyspark dataframe #47 java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries. spark Eclipse on windows 7 #48 Apache Spark: How to use pyspark with Python 3 #49 Extract column values of Dataframe as List in Apache Spark #50 Renaming column names of a DataFrame in Spark Scala
Read all the top votes questions and answers in a single page. #41: Spark DataFrame groupBy and sort in the descending order (pyspark) (Score: 101) Created: 2015-12-29 Last updated: 2019-01-06 Tags: python, apache-spark, dataframe, pyspark, …
-
Most votes on apache-spark questions 4
May 01, 2021 in FAQ
Most votes on apache-spark questions 4. #31 How to print the contents of RDD? #32 Filter Pyspark dataframe column with None value #33 How to overwrite the output directory in spark #34 importing pyspark in python shell #35 How to check if spark dataframe is empty? #36 Load CSV file with Spark #37 Convert spark DataFrame column to python list #38 How to change a dataframe column from String type to Double type in PySpark? #39 Spark Kill Running Application #40 How to load local file in sc.textFile, instead of HDFS
Read all the top votes questions and answers in a single page. #31: How to print the contents of RDD? (Score: 128) Created: 2014-04-19 Last updated: 2015-04-17 Tags: scala, apache-spark I’m attempting to print the contents of a collection to …
-
Most votes on apache-spark questions 3
May 01, 2021 in FAQ
Most votes on apache-spark questions 3. #21 Spark - load CSV file as DataFrame? #22 How to store custom objects in Dataset? #23 How are stages split into tasks in Spark? #24 How do I add a new column to a Spark DataFrame (using PySpark)? #25 Apache Spark: map vs mapPartitions? #26 How to convert rdd object to dataframe in spark #27 How to set Apache Spark Executor memory #28 Concatenate columns in Apache Spark DataFrame #29 How to define partitioning of DataFrame? #30 Write single CSV file using spark-csv
Read all the top votes questions and answers in a single page. #21: Spark - load CSV file as DataFrame? (Score: 154) Created: 2015-04-17 Last updated: 2018-07-24 Tags: scala, apache-spark, hadoop, apache-spark-sql, hdfs I would like to read a CSV in …