Posts

Showing posts with the label ssis

data warehouse Initial load from Oracle to SQL Server

Image
Clash Royale CLAN TAG #URR8PPP data warehouse Initial load from Oracle to SQL Server We are building a DWH and the initial load would be millions of rows. The data will later be updated every 10 minutes using SSIS package which will be like a few thousand rows.Data migration would be from Oracle to SQL Server. Can you suggest an efficient way of extracting data initially. Is using SQL Server Import and Export a good and faster option than SSIS for initial load? Thanks By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Best way to Load Data in data warehouse

Image
Clash Royale CLAN TAG #URR8PPP Best way to Load Data in data warehouse We are building a new near realtime(refreshed every 10 minutes) hospital data warehouse from scratch. Data lies on an oracle database and we are planning to use SSIS packages to extract data from Oracle and load in the SQL Server database. I am very new with DWHousing and need suggestions on building the DWH. Questions : 1) When extracting the data from Oracle should I import the complete tables or should I get only selected columns which I want? For example : If I have person,address,facility_hist tables should I join them in the extracting package and only get the selected columns? or should I extract all three tables separately in staging area and then combine them and load them in SQL Server. 2)Indexes should be created on the target tables or while extracting the data? 3) I am planning to do the initial load in batches by using the create_dt_tm for the records and load the data in months. Once everything is loa...

SSIS script task can't read project variable

Image
Clash Royale CLAN TAG #URR8PPP SSIS script task can't read project variable In my project.params I have variables such as LampUserName of type string. In my script task I'm then trying to read them like so: LampUserName foreach (var name in new string { "ServerName", "InitialCatalog", "UserName", "Password" }) { if (!Dts.Variables.Contains(string.Format("$Project::Lamp{0}", name))) { writer.WriteLine(name); } } string server_name = (string)Dts.Variables["$Project::LampServerName"].Value; string database = (string)Dts.Variables["$Project::LampInitialCatalog"].Value; string username = (string)Dts.Variables["$Project::LampUserName"].Value; string password = (string)Dts.Variables["$Project::LampPassword"].Value; Every one of those prints out that it doesn't exist and then an exception is thrown. Wha...