Portal GUI: Warning when using Hops not in the first DTL transform chain

Completed

Follow

andreas.krutnes

• October 10, 2022 09:38

Ref. documentation about Dependency Tracking and the note about:

"If you have multiple (chained) DTL transforms on a pipe, dependency tracking will only be enabled for hops located in the first transform of the chain. If you need to have multiple DTL transforms in a pipe, for instance if you have interleaved HTTP or REST transforms, then a work-around is to split the pipe into multiple pipes so the hops that require dependency tracking are located in the first DTL transform in one of them."

 

Feature Request: Show a warning info box in the Pipe "Config" GUI when a hops is used in a chained DTL and not present in the first transform chain.

2

• Official comment

  

  Geir Ove Grønmo

  • October 10, 2022 10:19
  • Edited

  Yes, we already have this on our planning board. We'll add a warn to pipes where hops are used, but dependency tracking won't be guaranteed or done. 

  Another example is if the pipe source is not a dataset.

  Comment actions Permalink
• 

  andreas.krutnes

  • October 10, 2022 10:20

  Very nice, thanks.

  0

  Comment actions Permalink
• 

  Geir Ove Grønmo

  • October 11, 2022 11:19

  We just merged warnings for pipes where dependency tracking won't be done or guaranteed. In practice you'll see it on non-dataset sources that has hops or pipes with hops in the non-first transform.

  1

  Comment actions Permalink
• 

  Geir Ove Grønmo

  • October 11, 2022 15:12

  Changelog: https://docs.sesam.io/changelog.html#changelog-2022-10-11

  0

  Comment actions Permalink
• 

  andreas.krutnes

  • October 12, 2022 08:26

  Reporting multiple bugs with the warnings:

  1. Duplicate warnings

  

  0

  Comment actions Permalink
• 

  andreas.krutnes

  • October 12, 2022 08:26

  2. Minimizing the warnings still takes up "real estate" on the screen, even while scrolling:

  

  0

  Comment actions Permalink
• 

  andreas.krutnes

  • October 12, 2022 08:27

  3. Warnings about dependency tracking will be disabled even though the dataset source is type dataset.

  

   

  0

  Comment actions Permalink
• 

  andreas.krutnes

  • October 12, 2022 08:29

  4. Duplicate warnings for each entry in hops "datasets":

  

  0

  Comment actions Permalink
• 

  andreas.krutnes

  • October 12, 2022 08:30

  5. Warnings says dependency tracking will be disabled even though only 1 transform exist (yes, the source is type dataset):

  

  0

  Comment actions Permalink

Please sign in to leave a comment.