Debatching(Splitting) XML Message in Orchestration using DefaultPipeline - BizTalk

{tocify} $title={Table of Contents}

Introduction

In this post we will walk through the process of debatching an xml

message in Orchestration using pipeline in Biztalk.

I have used the Default XML Receive pipeline to achieve it, but it can also be done by creating a custom pipeline which uses XML disassembler (where you can set the Envelope and Document Schema).

Pipeline is not available in Orchestration like other shapes, thus to use it we need to add reference to following assemblies(which will allow us to use methods in those assemblies) :

• Microsoft.XLANGs.Pipeline.dll
• Microsoft.BizTalk.Pipeline.dll

You can browse to the location BizTalk Installation Directory to find above dll's.

Most of the part of this post is borrowed from my earlier post which talks about debatching xml at receive port:
https://tech-findings.blogspot.in/2013/07/debatchingsplitting-xml-message-biztalk.html

Scenario

We receive many item information but its wrapped (Enveloped) , so to process each item we need to unwrap it (remove the envelope and split individual Item message).

Below is what we receive (Input) :

<ns0:Items xmlns:ns0="http://TestingSchemas.ItemEnvelope">
  <ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_0</ID> 
  <Name>Name_0</Name> 
  <Quantity>100</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
  <ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_0</ID> 
  <Name>Name_1</Name> 
  <Quantity>200</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1<:product gt="" span="">
  <ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_2</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_3</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_4</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_5</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_6</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_7</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_8</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
<ns1:Product xmlns:ns1="http://TestingSchemas.Item">
  <ID>ID_9</ID> 
  <Name>Name_2</Name> 
  <Quantity>300</Quantity> 
  <UnitPrice>100</UnitPrice> 
  </ns1:Product>
  </ns0:Items>

But we want (Output) :

      <ns0:Product xmlns:ns0="http://TestingSchemas.Item">

           <ID>ID_0</ID>

          <Name>Name_0</Name>

          <Quantity>100</Quantity>

          <UnitPrice>100</UnitPrice>

      </ns0:Product>

             .

             .

             .

             .

             .

     <ns0:Product xmlns:ns0="http://TestingSchemas.Item">

        <ID>ID_9</ID>

        <Name>Name_9</Name>

        <Quantity>100</Quantity>

        <UnitPrice>100</UnitPrice>

     </ns0:Product>

All right, let's see how we do it:

Steps in creating Solution

1. Create schema - document schema 

2. Create the wrapper - Envelope Schema

• Name the root node, I have named it Items.

• Click on "Schema" and go to Properties Window
• Set the property "Envelope" as Yes, as this schema will be used as envelope and this is the property which helps disassembler to recognize it.
• So far good, envelope schema is ready but what about the document which will be wrapped.

• In the Property window select "Imports" and click on the ellipsis 
• You will get Imports wizard pop-ed  out  .
• Click on add and select the document schema which we created in step 1.(Here it is Item schema)

• Click on the "Items" and go to property window and select the property Body XPath and set it to /*[local-name(<)='Items' and namespace-uri()='http://TestingSchemas.ItemEnvelope']. Doing so allows an Items node to contain any number of Item Document.
• Cool... Now we are ready with the resources, next is to validate schema, build it, sign it  and deploy.

3. Now lets create Orchestration which will receive the enveloped item and debatch/split it using the pipeline.

•         Receive shape is configured to receive untyped message i.e. of type System.Xml.XmlDocument (which will receive enveloped message -ItemEnvelope Type).
•         Then we have a "DebatchScope"  which is of type "Atomic" and Orchestration  is of type Long running. Why Atomic scope? Because we will be calling/executing Pipeline within it and the pipeline is of non- serializable type.
•         Next we have
•         It contains following line:  GetPipelineOutput=Microsoft.XLANGs.Pipeline.XLANGPipelineManager.ExecuteReceivePipeline(typeof(Microsoft.BizTalk.DefaultPipelines.XMLReceive),ItemsIn);
•         GetPipelineOutput is a DebatchScope variable of type: Microsoft.XLANGS.Pipeline.ReceivePipelineOutputMessages
•       So we are executing the method ExecuteReceivePipeline()  method of XLANGPipelineManager class  which belongs to Microsoft.XLANGs.Pipeline and its output assigned to  GetPipelineOutput.

•      Then we have a loop shape "UntilLastMessage" and its same as  while loop, below is the condition(till spillited messages are available): GetPipelineOutput.MoveNext(
•         Next is Construct shape with Message Assignment within it, which has following code:

 ItemOut = null;

          GetPipelineOutput.GetCurrent(ItemOut);

It is here where the splitted single  message is assigned to ItemOut , where ItemOut is a Message variable which is of type Item.xsd

•        At last we have Send shape which accepts message of type ItemOut and sends it .
•        Now what, build the project ,sign it and deploy.

4.Now create a Receive and Send port :

•        Receive Pipeline is PassThruReceive  as we don't want its message type to be detected until the message reaches to ExecutePipeline shape in Orchestration.

•        Now after both the ports are ready, it's time to bind it to the logical ports of our orchestration:

5. Start the application and test it, I will drop a envelope message at receive location which we saw at start  . So I should be getting 10 individual xml message at the destination location:

        Will keep on posting as an when I find something to share!!!!!!!!!!!!

If you have questions or suggestions, feel free to do in comments section below !!!

Do share if you find this helpful .......

 

                          Knowledge Sharing is Caring !!!!!!

Related Post 

• BizTalk Server: Multiple XML files to Single FlatFile Using File Adapter
• BizTalk 2013: Inserting RawXML (Whole Incoming XML Message) in SQL database
• BizTalk 2013: Inserting RawXML (Whole Incoming XML Message) in SQL database - Part 2
• Is it possible to have Map Chaining on the Port Level
• Promoting custom context property using Pipeline Component
• Custom ZipReceivePipeline to Unzip Multi-Type Messages
• Grouping and debatching Inbound Messages from WCF SQL Adapter - BizTalk 2010
• Polling data from SQL using WCF-SQL Adapter in BizTalk 2010 - TypedPolling(From Multiple table)
• Grouping XML Messages using custom XSLT- BizTalk 2010
• Insert Records in SQL Server using WCF-SQL Adapter in BizTalk 2010 - Composite operation(Multiple Records insertion)
• Insert Records in SQL Server using WCF-SQL Adapter in BizTalk 2010- Composite Operation (Message Transformation Pattern)
• Debatching(Splitting) XML Message - BizTalk 2010
• Debatching(Splitting) XML Message in Orchestration using DefaultPipeline - BizTalk 2010