question

MichaelDouglas-9473 avatar image
0 Votes"
MichaelDouglas-9473 asked MichaelDouglas-9473 answered

Form Recogniser form labelling tool - offset tables

I have looked at the table function on fott but I cannot see how I can deal with the sort of table below which can extend onto multiple pages.
The "column" headers are not really columns and the "rows" are not really rows, but obviously it is easily understood by a human.

I also looked on AI Build but I assume it is using the same background tools.

Can you advise the best way to tag and train this sort of table please?

Many Thanks
Michael

158011-image.png


azure-form-recognizerazure-applied-ai-services
image.png (88.1 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello Michael,

I am double check internally to see how we support EU format. Will let you know soon.


Regards,
Yutong

0 Votes 0 ·

Many thanks Yutong

This is part of a project I am working on that will be used widely across Europe on cross-border trade if we can get it to work.
We have looked at numerous solutions (Hyperscience, AA, Expedoc, Gropper, ABBYY etc) but they do not offer the level of intelligent document processing that is required, which is why we are interested in FR.

This is also part of a blockchain project which will utilise the output and some other Azure offerings.

Regards
Michael

0 Votes 0 ·

@MichaelDouglas-9473
I am sorry for the late since holiday season, I am still following up with the product group for the roadmap.


Regards,
Yutong

0 Votes 0 ·
YutongTie-MSFT avatar image
0 Votes"
YutongTie-MSFT answered

@MichaelDouglas-9473

Hello Michael, I did some research on my end and I think it's kindly working for me.

My solution here is custom model with V3.0 Form Recognizer in Form Recognizer Studio. Please check the link to see what is custom studio and what is FR studio.

What I have tried is, I created a table in FR studio and labeled related data as below:
162334-image.png

To transform those data to a form as the right.

Since the custom model function need at least 5 similar form for training but I only have one, my result is not kind of accurate, but it's close to what I expect to as below:

![162313-image.png][3]

I think this should be a good solution for your business. But one thing I should mention is, we are not supporting multi page tables, which means every item section should be in same page.

Hope this will help. Please let us know if any further queries.



  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators











image.png (291.0 KiB)
image.png (611.8 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

MichaelDouglas-9473 avatar image
0 Votes"
MichaelDouglas-9473 answered YutongTie-MSFT commented

Many thanks Yutong - really keen to get something on this :-)

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@MichaelDouglas-9473

Happy New Year Michael. I want to confirm my understanding is correct. Could you please check below pic which I add some markers? If the light blue are Gross Mass? Light pink are good descriptions? Light green are all Commodity Code?

Am I understand this table correct? I just got connection with the pm so I want to double confirm we are on the right way. Thanks a lot.
161722-125.png


0 Votes 0 ·
125.png (503.7 KiB)
MichaelDouglas-9473 avatar image
0 Votes"
MichaelDouglas-9473 answered MichaelDouglas-9473 published

Hi Yutong

Yes you have understood the table correctly :-)

Basically the top 2 sections (left and right) are the legend for each Item. There can be up to 99 items per document.

Best Regards
Michael

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

MichaelDouglas-9473 avatar image
0 Votes"
MichaelDouglas-9473 answered YutongTie-MSFT edited

Hi Yutong

Many thanks for this - I can see the process now.
Unfortunately many of these are on multiple pages so I will look at alternative solutions from the other major providers.

Appreciate your efforts :-)

Best Regards
Michael

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@MichaelDouglas-9473

One more thing I want to mention again, if every item section is in the same page, though the whole table will be more than 1 page, it will work.

Could you please kindly accept the answer if you feel the answer is helpful so that we can close here? Thanks.

Regards,
Yutong

0 Votes 0 ·

@MichaelDouglas-9473

Hello Michael, one more question please, is the barcode used for tracking table information? Good news is we are working on barcode extraction for your reference.

Regards,
Yutong

0 Votes 0 ·
MichaelDouglas-9473 avatar image
0 Votes"
MichaelDouglas-9473 answered

Hi Yutong

The barcode is actually the MRN number which is stated in text nearby. However it is useful to read the barcode as the MRN number is not always in the same place.

Just for your information, this "EAD" extraction requirement is part of a larger "Blockchain Europe" project which I am involved in with the Fraunhofer Institute. They are also looking to read EAD's and will start soon to do their own work. But I would prefer to use an existing major solution such as Forms Designer, so any development you do is really useful for us.

Kind Regards
Michael

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.