ETL is an acronym for Extract, Transform, and Load. It refers to a process of extracting data from source systems, transforming the data in some way (manipulating it, filtering it, combining it with other sources), and finally loading the transformed data to target system(s).
0
votes
0answers
23 views
Database from Excel Sheets
I have a problem statement.
A client of mine has three years of data in very complicated Excel Sheets. They are currently doing data entry, reporting and every thing basically in excel and these ...
0
votes
0answers
26 views
How to load data from SQL Server to SAP BW using SSIS
I would like to load data from SQL server to SAP BW using SSIS. Could some one help me on it how can i do it. Currently i am using sql server 2005.
2
votes
2answers
37 views
Replace missing values in SAS
How do you replace all missing values with zeroes in SAS? I have a text file that I dump into SAS to process some geo data, but whenever it has a missing value it breaks the operations. Is there a way ...
1
vote
1answer
25 views
How to use scriptella to read files from amazon S3 and load into a database say postgres. Any pointers on how to build a new connector for aws S3 ?
How do I use scriptella to read files from amazon S3. I do not see any S3 connector. In general how a remote set of files can be accessed using http/https. How easy it is to enhance the ...
1
vote
1answer
37 views
executing stored requests in a table and getting the values into a variable
I have a table T1 with a column 1 where I store some SQL requests in the pattern " select Var1 from T2". But the problem is that when I put "select A1 from T1" I get the request only in a form of a ...
0
votes
2answers
41 views
Neo4J and Talend BD inserting a relationship - node doesn't exist
I use Talend Open Studio Big Data to migrate my MySQL DB to Neo4j, i successfully migrated about 5 tables and 4 relations but I got stuck on a very weird problem. When inserting a relationship I get:
...
1
vote
1answer
17 views
Kettle: load CSV file which contains multiple data tables
I'm trying to import data from a csv file which, unfortunately, contains multiple data tables. Actually, it's not really a pure csv file.
It contains a header field with some metadata and then the ...
2
votes
0answers
42 views
Datawarehouse design: fact table for store system alarms
I'm a newbie in datawarehousing, but I am in charge of this task.
I need to create a schema (star) to store "Alarms"; so alarms comes from MySQL OLTP database and are a sort of log of access control ...
0
votes
0answers
12 views
Data Migration types
I am planning to merge two old databases and create one big datawarehouse. One of my colleagues told me that there are different type of data migration approaches.
Forward Migration
Reverse ...
0
votes
1answer
35 views
Severe error on MERGE OUTPUT statement
I'm getting a severe error - code 20, from a Merge statement and I am not sure why. The MERGE runs fine if I remove the OUTPUT $action clause, and updates/inserts the target table as expected. As soon ...
0
votes
1answer
17 views
Application retirement and database archiving
I have a constantly developing application and i want to archive its DB. The DB tables structures constantly change.
My idea is to develop non changing core structures (tables) of production tables. ...
1
vote
2answers
109 views
Parse Data with Many Attributes in Scala
I've been doing some self directed learning with weather data in Scala, because the data is free, big, and feeds into lots of other stuff I would like to do. Immediately I ran into trouble with how ...
0
votes
0answers
22 views
Visual Studio 2008 SSIS BIDS XSD File Location After Build and Deploy ETL
Visual Studio 2008
SSIS/BIDS
Windows Server 2008/Windows 7 Enterprise
We're building BIDS packages and running them via AutoSys. These BIDS packages have, as a component within a DataFlow, an XML ...
3
votes
2answers
73 views
Kettle: How to get max date for each group of rows
I'm reading an excel sheet using Kettle and this sheet has three fields: code, description and date.
Example:
1 - description A - 01/JAN/2013
2 - description A - 15/JAN/2013
3 - description A - ...
1
vote
3answers
46 views
QA testing process
I just had a question about the testing process. Who writes the test scenarios and who writes the test cases? Does the tester do anything besides test the test case or do they write the test case ...
