C++ CRTP based dataflow output class design simplification
c++,c++11,design-patterns,crtp,dataflow
In the original code, I identified three issues: std::declval<TLeafType*>() -> getOutput tries to look up a name in an incomplete class. std::declval<TLeafType*>() -> getOutput<N> does not name a function template getOutput. The getOutputImpl declarations in the derived class hide any member functions with the same name of the base class....
ssis data flow task defaults vs dts transform data task defaults
sql-server,ssis,bids,dts,dataflow
I would start with the following values, then increase them until they don't produce an improvement: Rows per Batch: 100000 Maximum Insert Commit Size: 100000 I also use Lock Table whenever I can. ...
Run Magento 1.9.1.0 Dataflow Import Profile Programmatically
php,xml,magento,import,dataflow
After much frustration, here's the answer that works: Note that in this case I've configured the default Magento Dataflow Profile for Import All Products (ID: 3) to read in an XML import format, from a predefined file. This is a file I create as needed prior to running the import...
TPL Dataflow block consumes all available memory
c#,.net,task-parallel-library,dataflow,tpl-dataflow
You seem to misunderstand how TPL Dataflow works. BoundedCapacity limits the amount of items you can post into a block. In your case that means a single char into the TransformManyBlock and single string into the ActionBlock. So you post a single item to the TransformManyBlock which then returns 1024*1024...
Cyclic IObservable Chain in Reactive .NET
c#,.net,system.reactive,reactive-programming,dataflow
The line Bar(fizzes, buzzes).Subscribe(f => fizzes.OnNext(f)); can be made simpler and changed to Bar(fizzes, buzzes).Subscribe(fizzes); as the Subscribe method takes an IObserver, the lambda methods that are normally used are just shortcuts for this. As such, fizzes is being used as an IObserver and an IObservable, which is the definition...
Dataflow diagram representing external files
diagram,dataflow,dataflow-diagram
A file is a data store, just like a database. There is nothing wrong with using that symbol in a dataflow diagram. And since the arrow goes in one direction only, it is static (aka read-only).
Unspecific Dataflow Import error in Magento
xml,magento,csv,import,dataflow
It turns out that the error was written in plain html. After copying it into a .html file and opening it in a browser a complete back-end Magento page popped up, stating that a module license was not valid (due to creating a staging area). After disabling the module, importing...