Apache Spark Committer
- Seattle
- http://www.viirya.org
Block or Report
Block or report viirya
Report abuse
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
Report abusePopular repositories Loading
-
-
-
-
-
puppet-hadoop Public
Puppet module for deploying Hadoop MapReduce Next Generation (MRv2)
1,070 contributions in the last year
Less
More
Contribution activity
December 2021
Created 6 commits in 3 repositories
Created 2 repositories
- viirya/packed_simd Rust
- viirya/vektor Rust
Created a pull request in apache/spark that received 20 comments
[SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning
What changes were proposed in this pull request? This patch fixes a bug in nested column pruning for Generate. The bug happens after we replace ex…
+40
−7
•
20
comments
Opened 1 other pull request in 1 repository
apache/arrow-datafusion
1
merged
Reviewed 10 pull requests in 2 repositories
apache/spark
8 pull requests
- [SPARK-36850][SQL][FOLLOWUP] Code clean up
- [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning
- [SPARK-37369][SQL] Avoid redundant ColumnarToRow transistion on InMemoryTableScan
- [SPARK-37569][SQL] Don't mark nested view fields as nullable
- [SPARK-37392][SQL] Fix the performance bug when inferring constraints for Generate
- [SPARK-37523][SQL] Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified
- [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark
- [SPARK-37450][SQL] Prune unnecessary fields from Generate