Apache Spark
Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 5,488 public repositories matching this topic...
-
Updated
Feb 18, 2021 - Python
-
Updated
Mar 7, 2021 - Go
-
Updated
Mar 4, 2021 - Python
-
Updated
Mar 6, 2021 - Python
Feature request: A way to set CUBEJS_CACHE_AND_QUEUE_DRIVER parameter from the cube.js file / config
As per the title
I wanted to use cubejs backend-server with an existing expressjs deployment, so I'm trying to avoid adding too many environment variables because they can be hard to keep track of (there are already many environment variables in the existing project) and I just thought it'd be a natural progression since most of the env configs can already be set from code :)
-
Updated
Dec 21, 2020 - Java
-
Updated
Oct 31, 2019
-
Updated
Mar 7, 2021 - Java
-
Updated
Feb 23, 2021 - Java
-
Updated
Dec 23, 2020 - Python
-
Updated
Mar 7, 2021 - Jupyter Notebook
-
Updated
Mar 7, 2021 - Java
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Mar 2, 2021
-
Updated
Jan 21, 2021 - Scala
-
Updated
Jan 27, 2021 - Python
-
Updated
May 26, 2019 - Scala
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
-
Updated
Jun 2, 2020 - JavaScript
-
Updated
Feb 15, 2021 - Jupyter Notebook
Used Spark version
2.4.3
Used Spark Job Server version
(Released version, git branch or docker image version)
0.9.0-SNAPSHOT
Deployed mode
(client/cluster on Spark Standalone/YARN/Mesos/EMR or default)
client spark standalone
Actual (wrong) behavior
curl -d "input.string = a b c a b see hello world ssdsds " 'localhost:8090/jobs?appName=test&classPath=spark.jobserver.WordCo
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.