Right way to access private data from Azure Data Factory












0














I am trying to understand what is the right architecture to use to access data from servers hosted on a private network (still running on Azure but not publicly accessible) and the Azure Data Factory service.



On some documentation Microsoft mentions the Integration Runtime as the solution:



https://docs.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime



While on other documentation it refers to a Data Gateway:
https://docs.microsoft.com/en-us/azure/analysis-services/analysis-services-gateway



Both articles seem fairly recent. The two applications have different recommended requirements (one mentions 8 CPU cores! Which is an overkill for my requirements to ship a few hundred megabytes per night)



Given that the data sources are running on Azure, just not publicly accessible, is there a way to connect Azure Data Factory directly?










share|improve this question



























    0














    I am trying to understand what is the right architecture to use to access data from servers hosted on a private network (still running on Azure but not publicly accessible) and the Azure Data Factory service.



    On some documentation Microsoft mentions the Integration Runtime as the solution:



    https://docs.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime



    While on other documentation it refers to a Data Gateway:
    https://docs.microsoft.com/en-us/azure/analysis-services/analysis-services-gateway



    Both articles seem fairly recent. The two applications have different recommended requirements (one mentions 8 CPU cores! Which is an overkill for my requirements to ship a few hundred megabytes per night)



    Given that the data sources are running on Azure, just not publicly accessible, is there a way to connect Azure Data Factory directly?










    share|improve this question

























      0












      0








      0







      I am trying to understand what is the right architecture to use to access data from servers hosted on a private network (still running on Azure but not publicly accessible) and the Azure Data Factory service.



      On some documentation Microsoft mentions the Integration Runtime as the solution:



      https://docs.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime



      While on other documentation it refers to a Data Gateway:
      https://docs.microsoft.com/en-us/azure/analysis-services/analysis-services-gateway



      Both articles seem fairly recent. The two applications have different recommended requirements (one mentions 8 CPU cores! Which is an overkill for my requirements to ship a few hundred megabytes per night)



      Given that the data sources are running on Azure, just not publicly accessible, is there a way to connect Azure Data Factory directly?










      share|improve this question













      I am trying to understand what is the right architecture to use to access data from servers hosted on a private network (still running on Azure but not publicly accessible) and the Azure Data Factory service.



      On some documentation Microsoft mentions the Integration Runtime as the solution:



      https://docs.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime



      While on other documentation it refers to a Data Gateway:
      https://docs.microsoft.com/en-us/azure/analysis-services/analysis-services-gateway



      Both articles seem fairly recent. The two applications have different recommended requirements (one mentions 8 CPU cores! Which is an overkill for my requirements to ship a few hundred megabytes per night)



      Given that the data sources are running on Azure, just not publicly accessible, is there a way to connect Azure Data Factory directly?







      azure azure-data-factory azure-data-factory-2






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 13 at 11:49









      jbx

      10.4k1057109




      10.4k1057109
























          1 Answer
          1






          active

          oldest

          votes


















          1














          The Self Hosted Integration Runtime in ADF should meet your requirement, this link gives a complete example to access data under Azure VNet or private network.






          share|improve this answer





















            Your Answer






            StackExchange.ifUsing("editor", function () {
            StackExchange.using("externalEditor", function () {
            StackExchange.using("snippets", function () {
            StackExchange.snippets.init();
            });
            });
            }, "code-snippets");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "1"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53280426%2fright-way-to-access-private-data-from-azure-data-factory%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            1














            The Self Hosted Integration Runtime in ADF should meet your requirement, this link gives a complete example to access data under Azure VNet or private network.






            share|improve this answer


























              1














              The Self Hosted Integration Runtime in ADF should meet your requirement, this link gives a complete example to access data under Azure VNet or private network.






              share|improve this answer
























                1












                1








                1






                The Self Hosted Integration Runtime in ADF should meet your requirement, this link gives a complete example to access data under Azure VNet or private network.






                share|improve this answer












                The Self Hosted Integration Runtime in ADF should meet your requirement, this link gives a complete example to access data under Azure VNet or private network.







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 13 at 14:52









                Wang Zhang

                2462




                2462






























                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Stack Overflow!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.





                    Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


                    Please pay close attention to the following guidance:


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53280426%2fright-way-to-access-private-data-from-azure-data-factory%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Guess what letter conforming each word

                    Port of Spain

                    Run scheduled task as local user group (not BUILTIN)