Showing posts with label tasks. Show all posts
Showing posts with label tasks. Show all posts

Tuesday, February 14, 2012

data flow,

Lets say I have 10 tasks in the data flow, but I want to execute only 5 tasks which don't depend on any other tasks in that data flow.
I don't want to execute all my tasks all the time while I am in development stage. Is it possible to execute that way? How can I do that?

Before answering can I just clarify something.

You can't put tasks into a data-flow so do you mean:
-Tasks in the control-flow
or
-Components in a data-flow

?

-Jamie|||Sorry for the confusion. Components in a data flow task.
So I have a data flow task created in Control flow and then I have
10 components (OLE DB Src and OLE DB dest connections) that extracts data and loads data in the Data Flow. I want to execute 2 out of those 10 to load my new 2 tables.

|||You can't stop tasks running in a dataflow. You can only limit how many sources are processing at the same time. So if you had 10 sources and only wanted 2 at a time you could set the EngineThreads property to 2 and only 2 would be going at any one time but all would get executed before the dataflow completed. If you don't want this then you would need to create separate dataflows for the ones you want to run together and then disable the dataflows you didn't want to run.

HTH,
Matt

Data Flow Tasks - SSIS

I am using Recordset destination for SSIS. Flat file destination will
not work and Excel destination can not handle more that 65k rows and I
don't want to send my output to the server. Therefore after doing a
Merge join I want to view the results and Recordset seemed to be a
valid choice. The problem is how do I view the output? For other
components sometimes there are preview option. However this preview is
not consistent for all steps in the data flow tasks and sometimes
missing. My question is there any way to preview the Recordset
destination? Thanks.On May 25, 11:38 am, SB <othell...@.yahoo.com> wrote:
> I am using Recordset destination for SSIS. Flat file destination will
> not work and Excel destination can not handle more that 65k rows and I
> don't want to send my output to the server. Therefore after doing a
> Merge join I want to view the results and Recordset seemed to be a
> valid choice. The problem is how do I view the output? For other
> components sometimes there are preview option. However this preview is
> not consistent for all steps in the data flow tasks and sometimes
> missing. My question is there any way to preview the Recordset
> destination? Thanks.
Okay, instead of Recordset I have used DataReaderDestination and
created a Grid viewer to view the data. The problem is, it is very
slow and hangs after processing 96k out of 396k of records. (This is
one simple update involving a 2 table join that I can do in seconds in
the server) It is taking hours to develop the package and when it did
come back it is only showing 9k out of 396k of data in the grid. How
do I see all the data? I have tried attach/detach but still can't seem
to view all the data! How do I view all the data in the grid? Thanks.

Data Flow Tasks - SSIS

I am using Recordset destination for SSIS. Flat file destination will
not work and Excel destination can not handle more that 65k rows and I
don't want to send my output to the server. Therefore after doing a
Merge join I want to view the results and Recordset seemed to be a
valid choice. The problem is how do I view the output? For other
components sometimes there are preview option. However this preview is
not consistent for all steps in the data flow tasks and sometimes
missing. My question is there any way to preview the Recordset
destination? Thanks.
On May 25, 11:38 am, SB <othell...@.yahoo.com> wrote:
> I am using Recordset destination for SSIS. Flat file destination will
> not work and Excel destination can not handle more that 65k rows and I
> don't want to send my output to the server. Therefore after doing a
> Merge join I want to view the results and Recordset seemed to be a
> valid choice. The problem is how do I view the output? For other
> components sometimes there are preview option. However this preview is
> not consistent for all steps in the data flow tasks and sometimes
> missing. My question is there any way to preview the Recordset
> destination? Thanks.
Okay, instead of Recordset I have used DataReaderDestination and
created a Grid viewer to view the data. The problem is, it is very
slow and hangs after processing 96k out of 396k of records. (This is
one simple update involving a 2 table join that I can do in seconds in
the server) It is taking hours to develop the package and when it did
come back it is only showing 9k out of 396k of data in the grid. How
do I see all the data? I have tried attach/detach but still can't seem
to view all the data! How do I view all the data in the grid? Thanks.

Data Flow Tasks - SSIS

I am using Recordset destination for SSIS. Flat file destination will
not work and Excel destination can not handle more that 65k rows and I
don't want to send my output to the server. Therefore after doing a
Merge join I want to view the results and Recordset seemed to be a
valid choice. The problem is how do I view the output? For other
components sometimes there are preview option. However this preview is
not consistent for all steps in the data flow tasks and sometimes
missing. My question is there any way to preview the Recordset
destination? Thanks.On May 25, 11:38 am, SB <othell...@.yahoo.com> wrote:
> I am using Recordset destination for SSIS. Flat file destination will
> not work and Excel destination can not handle more that 65k rows and I
> don't want to send my output to the server. Therefore after doing a
> Merge join I want to view the results and Recordset seemed to be a
> valid choice. The problem is how do I view the output? For other
> components sometimes there are preview option. However this preview is
> not consistent for all steps in the data flow tasks and sometimes
> missing. My question is there any way to preview the Recordset
> destination? Thanks.
Okay, instead of Recordset I have used DataReaderDestination and
created a Grid viewer to view the data. The problem is, it is very
slow and hangs after processing 96k out of 396k of records. (This is
one simple update involving a 2 table join that I can do in seconds in
the server) It is taking hours to develop the package and when it did
come back it is only showing 9k out of 396k of data in the grid. How
do I see all the data? I have tried attach/detach but still can't seem
to view all the data! How do I view all the data in the grid? Thanks.