Understanding BLEU for Machine Translation

KantanMT Whitepaper Improving your MT

It can often be challenging to measure the fluency of your Machine Translation engine,       and that’s where automatic metrics become very useful tool for the localization            engineer.

BLEU is one of the metrics used in KantanAnalytics for quality evaluation. BLEU Score is quick to use, inexpensive to operate, language independent, and correlates highly with human evaluation. It is the most widely used automated method of determining the quality of machine translation.

How to use BLEU ?

  1. To check the fluency of your KantanMT engine click on the ‘BLEU Scores’ tab. You will now be directed to the ‘BLEU Score’ page.bleu
  2. Place your cursor on the ‘Bleu Scores Chart’ to see the individual fluency score of each segment. . A pop-up will now appear on your screen with details of the segment under these headings, ‘Segment no.’, ‘Score’, ‘Source’‘Reference/Target’ and ‘KantanMT Output’.SEgment
  3. To see the ‘Bleu Scores’ of each segment in a table format scroll down. You will now see a table with the headings ‘No’, ‘Source’, ‘Reference/Target’, ‘KantanMT Output’ and ‘Score’.table
  4. To see an even more in depth breakdown of a particular ‘Segment’ click on the ‘Triangle’ beside the number of the segment you wish to view.
    Triangle
  5. To download the ‘BLEU Score’ of all segments click on the ‘Download’ button on the ‘BLEU Score’ page.download

This is one of the features provided by Kantan BuildAnalytics to improve an engine’s quality after its initial training .To see other features used by Kantan BuildAnalytics please click on the link below .To get more information about KantanMT and the services we provide please contact our support team at  at info@kantanmt.com.

What is KantanISR and Why do I need it ?

KantanISR technology enables KantanMT members to perform instant segment retraining using a pop-up editor. The technology is designed to permit the near-instantaneous submission of post-edited translations into a KantanMT engine so that KantanMT members can submit segments for retraining, hence bypassing the need to completely rebuild the engine.

KantanISR was developed with usability, efficiency and productivity in mind as members simply need to login to their KantanMT account, go to their main dashboard and submit new training segments using the KantanISR Editor. This adding of high quality training data to a KantanMT engine will improve the translation quality of that engine and reduce post-editing requirements.

Using KantanISR

      1. Login into your KantanMT account using your email and your password.
      2. You will be directed to the ‘My Client Profiles’ page. You will be in the ‘Client Profiles’section of the ‘My Client Profiles’ page. The last profile you were working on will be‘Active’.
      3. If you wish to use the ‘KantanISR’ with another profile other than the ‘Active’ profile. Click on the profile you wish to use the ‘KantanISR’ with, then click on the ‘Training Data’ tab.
      4. You will be directed to the ‘Training Data’ page. Now click on the ‘IRS’ tab.
      5. The ‘KantanISR’ wizard will now pop-up on your screen.
      6. Add the source language text in the ‘Source’ text editor fields. Add the corresponding target language text in the ‘Target’ text editor fields.
      7. Then click on the ‘Save’ button if your happy with your retraining data. If not click the‘Cancel’ button.
      8. When you click the save button a ‘KantanISR successful’ pop-up will appear on your screen, click the ‘OK’ button and you will be directed back to the ‘Training Data’ page.

Using KantanISR through KantanAPI

Please Note: The KantanAPI is only available to KantanMT members in the Enterprise Plan.

Members’ can also get the benefit of KantanISR through KantanAPI by using HTTP

GET requests. The API expects:

  • A user authorisation token (‘API token’) which can be gotten by clicking on the ‘API’
  • The name of the client profile you wish to use.
  • A source segment and its target segment in the languages specified when profile was created.

To learn more about KantanISR or get help with KantanMT technologies, please contact us at info@kantanmt.com. Hear from the Development team on why KantanISR increases productivity and efficiency for KantanMT customers.

 

Why you should use KantanAnalytics

What is KantanAnalytics?

things to think about when buying MTKantanAnalytics generates quality estimation scores for automated translations generated by KantanMT engines. The better the KantanAnalytics scores – the better the quality performance of a KantanMT engine as it means translations are more accurate and fluent and require less post-editing effort.

KantanAnalytics creates a detailed project management report of all segments within a KantanMT project. This includes segment-by-segment quality estimation scores in addition to other useful project statistics such as word, character, placeholder and tag counts.

KantanAnalytics can help Project Managers make the right decision as it predicts the cost and post-editing effort for Machine Translation projects. Prioritizing the right translations through segment quality estimation will yield the fastest possible project turn-around.

How to use KantanAnalytics

  1. Login into your KantanMT account using your email and your password.
  2. You will be directed to the ‘My Client Profiles’ page. You will be in the ‘Client Profiles’ section of the ‘My Client Profiles’ page. The last profile you were working on will be ‘Active’
  3. If you wish to view the ‘KantanAnalytics’ of another profile other than the ‘Active’ profile. Click on the profile you wish to view the ‘KantanAnalytics’ of, then click on the ‘Client Files’ tab.
  4. You will now be directed to the ‘Client Files’ page.
  5. Click on the ‘Analyse’ tab.
  6. A ‘Launch Job’ pop will now appear on your screen saying your job has been launched. Note the ‘Job ID’ Click on the ‘OK’ button on the ‘Launch Job’ pop-up.
  7. You will receive an email notification stating that your job has been launched in the email address you use to register on KantanMT.com.
  8. You will also receive an email notification when the job has been completed.
  9. Click on the ‘KantanMT’ tab and select ‘My Jobs’ from the drop down menu.
  10. You will now be directed to the ‘My Jobs’ page.
  11. Search for the job using the ‘Job ID’, you can use the ‘Search Bar’ or go to the ‘#’ column and scroll till you find the ‘Job ID’.
  12. Click on the analyse Icon beside the job to view the job analysis
  13. You will now be directed to the ‘KantanAnalytics Report’ page for the job.
  14. To exit out of the ‘KantanAnalytics Report’ page click on the ‘Back to My Jobs’ button.
  15. You will be directed back to the ‘My jobs’ page.

To download the ‘KantanAnalytics’ of the job click on the download icon

Additional Information

For more details on KantanAnalytics please see the following video below:

To learn more about KantanAnalytics or get help with KantanMT technologies, please contact us at info@kantanmt.com or visit the KantanMT website. Hear from the Development team on the benefits of KantanAnalytics

.

KantanMT @tekom Trade Fair and tcworld 2014

The KantanMT team are excited to be exhibiting for the first time at the tekom Trade Fair and tcword conference. This year, the event has found a new home at the International Congress Centre (ICS) Messe Stuttgart. This event, which is the largest of its kind is the biggest market place for technical communication in the world.

Not only will the KantanMT flag be flying high at the largest global TC event. But, KantanMT will also be taking part in sessions, tool presentations and offering personalized demos throughout the conference week. KantanMT are also offering its members a complimentary ticket to the tekom Fair with their registration.

KantanMT tekom trade fair, tcworld
Email us if you still need to get your free ticket (louisei@kantanmt.com)

Session: How does your machine Translation system measure up?

Tony O’Dowd, Founder and Chief Architect will be giving a presentation on evaluating machine translation. The presentation; ‘How does your machine Translation system measure up?’ is for localization professionals and will cover some of the most common yet critical issues for users of machine translation:

  • Measuring performance of Statistical MT
  • Recent advances in MT and data visualization techniques
  • Tracking MT efficiency in the translation process

Find it

What: Session

Where: Room C7.1OG

When: Wednesday 12th November @16:00 – 16:45

 

Joint Tool Presentation – Machine Translation for Translation Buyers: What is available and what is expected!

On the following day, KantanMT will be taking part in a joint tool presentation with German Language Service Provider (LSP) bmmt. Tony O’Dowd and Maxim Khalilov from bmmt will discussmachine translation for translation buyers: what is available and what is expected’. In this presentation, Tony and Maxim will give an overview of the current post-edited MT landscape and discuss with examples the formula for successful MT adoption, as well as what tools are available for global translation buyers. The full tool presentation program is available online on the tekom website.

Find it

What: Tool Presentation

Where: Room C10.1

When: Thursday 13th November @ 11:15 – 12:00

KantanMT_tcw-conference2014_Exhibitor

Personalized Platform Demonstrations

At the KantanMT exhibition booth, the KantanMT team will be giving personalized platform demonstrations that provide an ‘under the bonnet’ look at the cloud-based platform. The booth will be located in Hall C2 at booth A10, right next to bmmt; German LSP and KantanMT preferred partner.

Find it:

What: Personalized Platform Demonstrations

Where: KantanMT exhibition booth Hall C2, booth A10

When: Tuesday 11th – Thursday 13th November

 

Get the most out of the tekom/tcword conference – meet the teams

Large conferences and events can often be overwhelming and it’s easy to lose track of time and get wrapped up in the buzz and excitement of the event. To make sure you get the most from the conference, keep organized and make an appointment to speak with a member of the KantanMT or bmmt team.

KantanMT team – contact Louise Irwin (louisei@kantanmt.com)

Bmmt team – contact Peggy Lindner (peggy.lindner@bmmt.eu)

See you in Stuttgart!