Apache Spark
Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 5,375 public repositories matching this topic...
-
Updated
Dec 21, 2020 - Python
-
Updated
Jan 19, 2021 - Go
-
Updated
Jan 19, 2021 - Python
-
Updated
Jan 19, 2021 - Python
Hey!
Currently, there are no plans to add support for it (from core team), but we are happy to merge and help with contribution from the community.
For driver implementer, take a look at
https://github.com/cube-js/cube.js/blob/master/CONTRIBUTING.md#implementing-sql-dialect
Example of driver implementation
Who are interested in prepari
-
Updated
Dec 21, 2020 - Java
-
Updated
Oct 31, 2019
-
Updated
Jan 19, 2021 - Java
-
Updated
Nov 30, 2020 - Java
-
Updated
Dec 23, 2020 - Python
-
Updated
Jan 19, 2021 - Jupyter Notebook
-
Updated
Jan 19, 2021 - Java
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Jan 19, 2021 - Scala
-
Updated
Dec 23, 2020 - Python
-
Updated
May 26, 2019 - Scala
Hi, if my spark app is using 2 storage type, both S3 and Azure Data Lake Store Gen2, could I put spark.delta.logStore.class=org.apache.spark.sql.delta.storage.AzureLogStore, org.apache.spark.sql.delta.storage.S3SingleDriverLogStore
Thanks in advance
-
Updated
Jun 2, 2020 - JavaScript
-
Updated
Dec 15, 2020 - Jupyter Notebook
Used Spark version
2.4.3
Used Spark Job Server version
(Released version, git branch or docker image version)
0.9.0-SNAPSHOT
Deployed mode
(client/cluster on Spark Standalone/YARN/Mesos/EMR or default)
client spark standalone
Actual (wrong) behavior
curl -d "input.string = a b c a b see hello world ssdsds " 'localhost:8090/jobs?appName=test&classPath=spark.jobserver.WordCo
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
-
Updated
Jan 9, 2021 - Java
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.