Skip to content
#

hdfs

Here are 542 public repositories matching this topic...

seaweedfs
kszucs
kszucs commented Jan 21, 2019

Along with the tests:

 /ibis/ibis/expr/api.py:318: DeprecationWarning: ibis.nanosecond is deprecated, use ibis.interval(nanoseconds=n) instead
    warnings.warn(msg.format(name), DeprecationWarning)
  /ibis/ibis/expr/api.py:318: DeprecationWarning: ibis.microsecond is deprecated, use ibis.interval(microseconds=n) instead
    warnings.warn(msg.format(name), DeprecationWarning)
  /ibis/i
ihnorton
ihnorton commented Jul 15, 2019

@stavrospapadopoulos is planning to do a full pass on the docs in the next development cycle to improve consistency, including:

  • further clarification of the capacity definition (ref #1167).
  • change the parameter from capacity -> sparse_capacity
  • per @jakebolewski, set_capacity needs to return the dense capacity (e.g. for a HL api iterator over tiles)
kuzemchik
kuzemchik commented Aug 5, 2015

We have multiple DC with different HDFS. Basically if you want to work like that you have to provide name node as parameter to snakebite.
Recently we faced the issue when folder with important data was deleted without moving to .Trash.
I investigated code a little bit.
Issue 1: So, 'skiptrash' configuration is not used by code, I assume documentation wasn't updated on this.
Issue 2: It looks like

abhisheksahani
abhisheksahani commented Oct 20, 2019

Hi we have 25 topics each topic having 2 partition , we have created connect config having topics.regex, so that connector consumes from all 25 topics with tasks.max set to 50 i.e(one unique consumer per partition) but when we describe the consumer group only two unique consumers are attached to 50 partition.

here's the config:
{
"name": "testConnectorfinalTest04",
"config": {

twiechert
twiechert commented Mar 7, 2019

We use the connect ui in a Kubernetes setup where a sidecar of the connect-ui is notified when a new connect cluster joins. This sidecar updates then the caddy server configuration (mostly proxy settings).

Unfortunately, the caddy server does not restart automatically in case of config changes.

Proposal: use a tool like inotifywait that listens on changes of the caddy config and restart th

80+ DevOps & Data CLI Tools - AWS, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, Ambari, Blueprints, CloudFormation, Elasticsearch, Solr, Pig, IPython - Python / Jython Tools

  • Updated Jun 12, 2020
  • Python
realmbgl
realmbgl commented Jun 26, 2017

Document how CONFIG_TEMPLATE_PATH has to be used in the configs section of the svc.yml.

         template: {{CONFIG_TEMPLATE_PATH}}/myconfig.yml

For the local yml test BasicServiceSpecTest.java [73] sets CONFIG_TEMPLATE_PATH, for the distribution it has to be set to frameworkname-scheduler in the env section of the marathon.json.mustache.

NNAnalytics

Improve this page

Add a description, image, and links to the hdfs topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the hdfs topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.