Developer metadata requirements

Question

I have been instructed to provide a list of metadata requirements that may be required by the developers of our data warehouse.

This is not business metadata (great descriptions, etc.), but the data needed to manage change (also known as impact assessment), a data line, etc.

I saw this Meta Meta Data Data article - Ralph Kimball , but since I'm not the first person, m throwing him into the SO community.

The actual question is: What metadata is needed for DataWare developers to develop, develop, and manage changes to ETL procedures?

PS: I'm trying to keep the response platform agnostic, but for context it is an Oracle database with PL / SQL and Datastage.

Answer 1

tablename.fieldname, . , , , . , If ( /Format/table ), ( ETL ). , , ETL , , , - , ETL.

ETL ETL, ETL, , / ETL. , ETL , , /Format/table/etc. . " ", , . -, ETL, ETL, , //, , .

ETL - - , . , / .. ETL.

, , "Person.FirstName" - , , , , .

, , Person.FirstName - , , , / , - . , / DDL, , ETL .

, , sp_Person_Load, sp_Person_Clean, sp_Person_Transform Person.FirstName, , .

, sp_Person_Clean Person.Firstname, sp_Person_Load. , . , , . , , ETL. ETL , ETL // , , .

, , , . ETL . , - , , ETL , , , ETL.

, , , . ETL sp_Person_Clean, emtadata, , sp_Person_Transform /. . , , - , , ETL. , ETL . , , , ETL.

, "", , , . , . , , " ", ETL . ETL SQL script, . , , / ETL.

, . / , , , . , . , , , . , SQL, , , .

, , , , . , , , , SQL, , , . , - Talend , , , .

Answer 2

home- brew ETL. , :). , , . , , , .

: , , /, . ftp/http, . , SP, - " ".

, , , , / .

, . . . , .

Run_order - , , (Y/N) .

( ). , - / . .

. . ( ). , SQL- ( ). , .

, , .