Sunday, June 30, 2019

Using Azure DevOps to collaborate Data Scientists and App Developers


What is your most favorite IDE? A developer can mention various of IDE’s. How about data scientist?


Normally, the Developers develop the code and data scientists train develop and train the model. Tools such as VSCode come in handy as easy to install and use. Many have many preferences so the chances are that it can be a choice of the developer or the development team. Usually the trained model is handed over to the app developer for integrating it and build the final application. There are times where the mismatches in compatibility can cost both the app developer and the model developer. The resulting friction between app developers and data scientists to identify and fix the root cause can be a slow, frustrating, and expensive process
We often here organizations including managers continuously talking about Artificial Intelligence. People like to find solutions that are integrated with AI. So as the developers have a development lifecycle, the data scientists follow a data science lifecycle. 

The lifecycle includes processes such as,

Data Ingestion --> Data Preparation --> Model Development --> Model Deployment

There can be many iterations of this lifecycle as there can be requirements for changing the data labels, removing anomalies, changes upon user feedback and timely decision changes and many more. 
Application Development Lifecycle for a developer includes building app, testing, maintaining, and continuously adopt to changes in user requirements where the models of data scientists also can be a part of. There shall be a good understanding between the application developers and model developers as mismatches can lead to errors in the integrated systems. I have seen many issues with even traditional SSRS implementations to web applications. When the model changes, app fails. 

Azure DevOps and Azure Machine Learning are combined to overcome this issue with a solution suggested by Microsoft as shown in the image below. 

Source: Azure Blog

Both the app developers and model developers need to use Git as the repository for managing the development artifacts. 

If we simplify this process to understand, the model training code developed by the data scientist will trigger the Azure DevOps CI/CD Pipeline as available on the right top of the diagram above. There the developer can execute multiple steps such as unit tests, integration tests, training and etc.. The changes made by the app developer will trigger integration tests whenever a code change is pushed to the repository. There can be triggers set on data lake as well to execute different commands. The Model Store will register the new models and trigger releases for human approval followed by many other necessary tests as shown in the bottom right. These procedures will help both the developers coordinate and work well within the changes required as well. 
The detailed article on Azure Blog can be found here.

84 comments:

  1. This implies the labyrinth has no out of reach segments, no roundabout ways, no open territories.ExcelR Data Science Courses

    ReplyDelete
    Replies
    1. Great Article
      Cloud Computing Projects


      Networking Projects

      Final Year Projects for CSE


      JavaScript Training in Chennai

      JavaScript Training in Chennai

      The Angular Training covers a wide range of topics including Components, Angular Directives, Angular Services, Pipes, security fundamentals, Routing, and Angular programmability. The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training

      Delete
  2. Very informative post! There is a lot of information here that can help any business get started with a successful social networking campaign. Admond Lee

    ReplyDelete
  3. I admire this article for the well-researched content and excellent wording. I got so involved in this material that I couldn’t stop reading. I am impressed with your work and skill. Thank you so much. anaconda install tensorflow

    ReplyDelete
  4. I am looking for and I love to post a comment that "The content of your post is awesome" Great work!

    Digital marketing course

    ReplyDelete
  5. Thanks for the informative article. This is one of the best resources I have found in quite some time. Nicely written and great info. I really cannot thank you enough for sharing.

    AWS Online Training
    AWS Certification Training
    AWS Certification Course Online
    AWS Training
    AWS Online Course

    ReplyDelete
  6. I recently found many useful information in your website especially this blog page. Among the lots of comments on your articles. Thanks for sharing. apps

    ReplyDelete
  7. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.

    data science course

    ReplyDelete
  8. wonderful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. This article resolved my all queries.
    Data Science Course

    ReplyDelete
  9. This is very significant, and yet necessary towards just click this unique backlink: northshore connect to success

    ReplyDelete
  10. Wow, cool post. I'd like to write like this too - taking time and real hard work to make a great article... but I put things off too much and never seem to get started. Thanks though. Tableau Data Blending

    ReplyDelete
  11. I am looking for and I love to post a comment that "The content of your post is awesome" Great work!

    Correlation vs Covariance

    ReplyDelete
  12. Thanks for the valuable information and insights you have so provided here... buy instagram likes cheap paypal

    ReplyDelete
  13. I am really enjoying reading your well written articles. It looks like you spend a lot of effort and time on your blog. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work.

    data analytics courses hyderabad
    data science training
    business analytics course

    ReplyDelete
  14. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!


    business analytics course
    data science course in hyderabad
    data analytics courses hyderabad

    ReplyDelete
  15. I like viewing web sites which comprehend the price of delivering the excellent useful resource free of charge. I truly adored reading your posting. Thank you!
    data science training in guwahati

    ReplyDelete
  16. It is the kind of information I have been trying to find. Thank you for writing this information. It has proved utmost beneficial for me. faça o download do Appvn apk 2020

    ReplyDelete
  17. I really like your take on the issue. I now have a clear idea on what this matter is all about.. acesse aqui para baixar Lucky Patcher 2020

    ReplyDelete
  18. I am really enjoying reading your well written articles. It looks like you spend a lot of effort and time on your blog. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work.

    Simple Linear Regression

    Correlation vs Covariance

    ReplyDelete
  19. That is really nice to hear. thank you for the update and good luck. blackmart alpha 0 49 b 93 apk

    ReplyDelete
  20. This is such a great resource that you are providing and you give it away for free. I love seeing blog that understand the value of providing a quality resource for free. visit site

    ReplyDelete
  21. Very interesting blog. Many blogs I see these days do not really provide anything that attracts others, but believe me the way you interact is literally awesome.You can also check my articles as well.

    Data Science In Banglore With Placements
    Data Science Course In Bangalore
    Data Science Training In Bangalore
    Best Data Science Courses In Bangalore
    Data Science Institute In Bangalore

    Thank you..

    ReplyDelete
  22. I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.

    Simple Linear Regression

    Correlation vs Covariance

    ReplyDelete
  23. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. This article inspired me to read more. keep it up.
    Correlation vs Covariance
    Simple linear regression
    data science interview questions

    ReplyDelete
  24. Utilize the @mentions highlight of Twitter that will assist you with building more grounded connections and draw in a more focused on crowd's consideration.how to grow twitter followers

    ReplyDelete
  25. Took me time to understand all of the comments, but I seriously enjoyed the write-up. It proved being really helpful to me and Im positive to all of the commenters right here! Its constantly nice when you can not only be informed, but also entertained! I am certain you had enjoyable writing this write-up. uk iptv

    ReplyDelete
  26. Thanks for the blog loaded with so many information. Stopping by your blog helped me to get what I was looking for. text message marketing for small business

    ReplyDelete
  27. Enjoy millions of the latest Android apps, games, music, movies, TV, books, magazines & more. Apps

    ReplyDelete
  28. I’m going to read this. I’ll be sure to come back. thanks for sharing. and also This article gives the light in which we can observe the reality. this is very nice one and gives indepth information. thanks for this nice article... hikedatabase.com/united-states/hiking-in-rhode-island/

    ReplyDelete
  29. Maintaining: The Science maintains the processed data using data warehousing, data cleansing, data staging, and data architecture. data science course in hyderabad

    ReplyDelete
  30. Very nice blogs!!! i have to learning for lot of information for this sites…Sharing for wonderful information.Thanks for sharing this valuable information to our vision. You have posted a trust worthy blog keep sharing, data science training in Hyderabad

    ReplyDelete
  31. I am looking for and I love to post a comment that "The content of your post is awesome" Great work! data science courses

    ReplyDelete
  32. Let us look into another technological breakthrough where this science can be a great help. The self-driving car is the best instance here. Live details or information from sensors, radars, lasers and cameras generally create the map of surroundings for self-driving cars. data science course syllabus

    ReplyDelete
  33. Can’t tell a good article, because it is more than that, thanks keep going...
    PLACEMENT TRAINING

    ReplyDelete
  34. This can be achieved by meeting all those who are going to be involved with the project. As we all know, consulting is a business which involves interaction and close coordination, so find the best output for your business by selecting the ideal Salesforce Consulting Company. Salesforce training in Hyderabad

    ReplyDelete
  35. This is why it is better that you should linked review before developing. It is possible to post superior send that way. App Development

    ReplyDelete
  36. The Master's Guide to text marketing services
    A large number of private companies use instant message advertising to empower expanded promoting commitment from possibilities and clients. As far as we can tell, most independent ventures use text showcasing to produce expanded client securing, convey advancements and warnings, augment client support viability, and increment inside productivity.
    From retail organizations and not-for-profit associations to land and eateries, text showcasing is utilized by more independent companies than at any time in recent memory.

    ReplyDelete
  37. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!

    data science course in India

    ReplyDelete
  38. Its a great pleasure reading your post.Its full of information I am looking for and I love to post a comment that "The content of your post is awesome" Great work. Log Cost CRM

    ReplyDelete
  39. You delivered such an impressive piece to read, giving every subject enlightenment for us to gain information. Thanks for sharing such information with us due to which my several concepts have been cleared. Legacy data archiving

    ReplyDelete
  40. Very good points you wrote here..Great stuff...I think you've made some truly interesting points.Keep up the good work.data science course in Hyderabad

    ReplyDelete
  41. Texting is an extremely effective communication & marketing channel for tax preparation services. 98% of text messages are read within 3 minutes of receipt! That’s significant when you consider that 90% of emails are considered SPAM so email marketing for tax professionals just isn’t as effective anymore. Whether you are marketing an accounting firm or just practice marketer

    ReplyDelete
  42. I want to say thank you so much and sharing this excellent article about DevOps Consulting Services.

    ReplyDelete
  43. Notice:Publishers are free to use this article on an ezine or website provided the article is reprinted in its entirety, including copyright and disclaimer, and ALL links remain intact and active. data science course in india

    ReplyDelete
  44. Textellent offers a texting service specially designed for the TaxPro. It works directly with all the leading software for tax preparers allowing you to provide exceptional and personal customer service while supporting you in marketing tax services as well tax preparation software

    ReplyDelete
  45. You've covered all points very clearly I was looking for. Thank you for sharing useful information.

    ReplyDelete
  46. I've read this post and if I could I desire to suggest you some interesting things or suggestions. Perhaps you could write next articles referring to this article. I want to read more things about it!
    Data Science courses

    ReplyDelete
  47. TAXPRO is a chief expert administration firm enhancing the matter of its customers for over 30 decades. We do this by giving a wide array of administrations in the monetary space which ranges from Entry Level Strategy, Taxation consultancy administrations, GST, Audit and Assurance, Accounting, Corporate Compliance, Payroll Services, ESI/PF Consultancy, and part more. We are a group of expense experts that incorporates Chartered Accountants, Advocates, Company Secretaries, Financial counselors offering marketing for accounting firm to the makers, Traders, Dealers, and specialist organizations of the business. Our administrations are looked for different business, lawful, and tax assessment confusions.

    ReplyDelete
  48. Thank you for your posting about aws blogs. It is useful to freshers who start to get knowledge about the aws. I got basic idea with the help of your details..
    https://www.kellytechno.com/Hyderabad/Course/amazon-web-services-training

    ReplyDelete
  49. Amazing! Its really amazing piece of writing, I have got much clear idea concerning from this piece of writing.
    data scientist course in hyderabad

    ReplyDelete
  50. MAJOR168 is open for football betting today. There are many big camps together BTi SBOBET IBCBET CMD365 if you are looking for a football betting website. Do not miss this site, there is football, there are all sports in the world. คาสิโนออนไลน์. Betting is available 24 hours a day with the best odds per pair in Thailand. Guaranteed automatic deposit and withdrawal system 10 seconds.

    Live sports betting Online football betting Good price with every football match open for today online football betting SAGAME88 There are many big camps together, SBOBET IBCBET BTi CMD365, the only website complete in online football betting คาสิโนออนไลน์. There is every sport on the planet in here. With the automatic deposit and withdrawal system for 10 seconds, we have a live football system to watch every night.


    We offer a wide variety of services. Called him the only player to finish with everything else does not have to go to the web preview ufabet as online. Online casinos Baccarat online Online betting games, Slot online, and with new technology, you can play ufabet via mobile phone today. Mobile Baccarat, play online via the website


    Ufabet1688 of us again the way we are websites directly, not through a General Services, where customers will know it absolutely was extremely really no cheating possible on-site gambling online, it is ufabet1688 of us will hit prices.

    ReplyDelete
  51. Online lottery, Thai lottery, Malaysian lottery, Vietnamese lottery is available for you to play all. End every need, good price, get a lot, less waste. There are more than 100 slot games, fun, สมัคร ufa, easy to play, beautiful images, beautiful graphics, fast bonus if you want to get money quickly Must play slots

    ReplyDelete
  52. สล็อตออนไลน์ (Slot Online) คือการนำเครื่องเล่นพนัน ตู้สล็อตแมชชีน ที่กล่าวมาข้างต้นนี้ นำมาทำเป็นเกมอิเล็กทรอนิกส์ที่เรียกกันว่า สล็อตออนไลน์ เนื่องด้วยยุคสมัยพัฒนาคนหันมานิยมเล่นพนันกันผ่านคอมพิวเตอร์ จะได้นำเกมสล็อตมาทำเป็นเกมพนันออนไลน์ ผ่านระบบเครื่อข่ายอินเตอร์เน็ต ซึ่งผู้เล่นสามารถเล่นแบบผ่าน โปรแกรมสล็อต ก็ได้หรือจะเป็นการเข้าเล่น Slots ผ่านหน้าเว็บไซต์ผู้ให้บริการ ซึ่งบริการเกม สล็อตออนไลน์ นั้นก็มีรูปแบบของกติกาการเล่น คล้ายกันกับการเล่นบนตู้สล็อตแมชชีน ทั้งภาพและเสียงสมจริงเร้าใจไม่แพ้กันกับไปนั่งเล่นในคาสิโนเลยทีเดียว.

    ReplyDelete
  53. If you are looking for a good website, ufa, UEFA BET casino site. Which can be played as a complete solution, able to answer Both in terms of quality and performance that are quite diverse It is best to have a lot of these things.

    ReplyDelete
  54. ufabet Parent company, the most popular online gambling website, whether it is online football betting Online casinos Baccarat online All of them were not less popular than each other. Become a member of UEFA Bet Playing with the parent company Did not pass agent Bet on a variety of casino games Especially the gambler who likes to Online football betting Our website provides 4 football odds, football betting, a minimum of 10 baht , betting is easy

    ReplyDelete
  55. Very nice article. I enjoyed reading your post. very nice share. I want to tweet this to my followers. Thanks !.
    data scientist training and placement in hyderabad

    ReplyDelete
  56. Great to become visiting your weblog once more, it has been a very long time for me. Pleasantly this article i've been sat tight fosuch a long time. I will require this post to add up to my task in the school, and it has identical subject along with your review. Much appreciated, great offer. data science course in nagpurr

    ReplyDelete
  57. Generally excellent review. I absolutely love this site. Much appreciated!
    best interiors

    ReplyDelete
  58. Great to become visiting your weblog once more, it has been a very long time for me. Pleasantly this article i've been sat tight for such a long time. I will require this post to add up to my task in the school, and it has identical subject along with your review. Much appreciated, great offer. data science course in nagpur

    ReplyDelete
  59. Wonderful blog found to be very impressive to come across such an awesome blog. I should really appreciate the blogger for the efforts they have put in to develop such an amazing content for all the curious readers who are very keen of being updated across every corner. Ultimately, this is an awesome experience for the readers. Anyways, thanks a lot and keep sharing the content in future too.

    Data Science Course in Bhilai

    ReplyDelete
  60. I was just browsing through the internet looking for some information and came across your blog. I am impressed by the information that you have on this blog. It shows how well you understand this subject. Bookmarked this page, will come back for more. data science course in mysore

    ReplyDelete
  61. I was just browsing through the internet looking for some information and came across your blog. I am impressed by the information that you have on this blog. It shows how well you understand this subject. Bookmarked this page, will come back for more. data science course in surat

    ReplyDelete
  62. Brilliant Blog! I might want to thank you for the endeavors you have made recorded as a hard copy of this post. I am trusting a similar best work from you later on also. I needed to thank you for these sites! Much obliged for sharing. Incredible sites!
    data science training institute in hyderabad

    ReplyDelete
  63. Thanks for posting the best information and the blog is very good.data science course in ranchi

    ReplyDelete
  64. Thanks for posting the best information and the blog is very good.data analytics course in rajkot

    ReplyDelete
  65. Thanks for posting the best information and the blog is very good.data science course in udaipur

    ReplyDelete
  66. Thanks for posting the best information and the blog is very good.business analytics course in rajkot

    ReplyDelete
  67. Thanks for posting the best information and the blog is very good.business analytics course in ranchi

    ReplyDelete
  68. Really good information and useful content. Thanks for sharing with us. Keep doing update blogs more.
    Data Science Certification in Hyderabad

    ReplyDelete
  69. I just couldn't leave your website before telling you that I truly enjoyed the top quality info you present to your visitors? Will be back again frequently to check up on new posts. business analytics course in kanpur

    ReplyDelete
  70. Thanks for posting the best information and the blog is very good.data analytics courses in ranchi

    ReplyDelete
  71. Thanks for posting the best information and the blog is very good.data science training in udaipur

    ReplyDelete
  72. Thanks for posting the best information and the blog is very good.business analytics course in udaipur

    ReplyDelete
  73. Excellent read, Positive site, I have read a few of the articles on your website now, and I really like your style.

    ecommerce services provider in india

    ecommerce solutions

    ReplyDelete
  74. Excellent effort to make this blog more wonderful and attractive.
    data science classes in hyderabad

    ReplyDelete
  75. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors
    data analytics course in thiruvananthapuram

    ReplyDelete
  76. The Digi uprise Course in Rajouri Garden most popular course "Foundations," teaches students the basic principles that comprise The Digi uprise Framework. It helps them identify the market, listen to clients, and decrease the possibility of missing out on potential opportunities.

    ReplyDelete
  77. origynivf is proud and satisfied to have an outstanding success rate and excellence under her supervision. Origyn IVF center is one of the India’s largest IVF center/Test Tube Baby Center in North India having highly advanced equipments & IVF techniques It is an Initiative to originate new life, through the best team effort.

    ReplyDelete
  78. The
    Best Dietitian and Nutritionist in Delhi - Diet Mantra by Monika
    by Monika is focused on providing expert nutritional advice to suit your body needs and empowering you in making lasting lifestyle changes. One of the biggest challenges one faces in today’s fast-paced life is how to actually keep up with the time crunch and how to actually follow a healthy lifestyle. Taking the right regimen for good wellbeing is significant and according to the various maladies and diseases, it is critical to have a solid eating routine with the goal that the immunity system could help to defend the infection and can help to improve your health. We offer online diet consultation so our customers get handily associated with us with no hustle. Monika Manchanda has been awarded as the best dietitian & nutritionist in Delhi.

    ReplyDelete