Presto Cassandra Connector : number of connections












2















I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html



This is my scylladb.properties file



connector.name=cassandra
cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
cassandra.client.read-timeout=3600000ms
cassandra.split-size=1024
cassandra.fetch-size=5000
cassandra.load-policy.token-aware.shuffle-replicas=true
cassandra.load-policy.use-token-aware=true


What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks










share|improve this question





























    2















    I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html



    This is my scylladb.properties file



    connector.name=cassandra
    cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
    cassandra.client.read-timeout=3600000ms
    cassandra.split-size=1024
    cassandra.fetch-size=5000
    cassandra.load-policy.token-aware.shuffle-replicas=true
    cassandra.load-policy.use-token-aware=true


    What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks










    share|improve this question



























      2












      2








      2








      I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html



      This is my scylladb.properties file



      connector.name=cassandra
      cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
      cassandra.client.read-timeout=3600000ms
      cassandra.split-size=1024
      cassandra.fetch-size=5000
      cassandra.load-policy.token-aware.shuffle-replicas=true
      cassandra.load-policy.use-token-aware=true


      What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks










      share|improve this question
















      I am looking into increasing the number of connections Presto makes to ScyllaDB. I am using Presto's Cassandra connector to connect to ScyllaDB. I don't see any property in the documentation that can be used to increase the number of connections. https://prestodb.io/docs/current/connector/cassandra.html



      This is my scylladb.properties file



      connector.name=cassandra
      cassandra.contact-points=scylla1,scylla2,scylla3,scylla4
      cassandra.client.read-timeout=3600000ms
      cassandra.split-size=1024
      cassandra.fetch-size=5000
      cassandra.load-policy.token-aware.shuffle-replicas=true
      cassandra.load-policy.use-token-aware=true


      What is the default number of connections that Presto makes to cassandra/scylladb and how can I set this property? Thanks







      prestodb scylla






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 20 '18 at 23:23









      phact

      6,6171224




      6,6171224










      asked Nov 19 '18 at 21:10









      jaspreet kaur bassanjaspreet kaur bassan

      5117




      5117
























          1 Answer
          1






          active

          oldest

          votes


















          4














          Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:




          • Coordination and data fetching is distributed among several coordinators

          • Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes


          See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100






          share|improve this answer


























          • @jaspreet kaur bassan - have you tried this?

            – TomerSan
            Dec 3 '18 at 8:51











          • I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

            – jaspreet kaur bassan
            Dec 9 '18 at 6:29













          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382678%2fpresto-cassandra-connector-number-of-connections%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          4














          Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:




          • Coordination and data fetching is distributed among several coordinators

          • Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes


          See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100






          share|improve this answer


























          • @jaspreet kaur bassan - have you tried this?

            – TomerSan
            Dec 3 '18 at 8:51











          • I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

            – jaspreet kaur bassan
            Dec 9 '18 at 6:29


















          4














          Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:




          • Coordination and data fetching is distributed among several coordinators

          • Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes


          See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100






          share|improve this answer


























          • @jaspreet kaur bassan - have you tried this?

            – TomerSan
            Dec 3 '18 at 8:51











          • I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

            – jaspreet kaur bassan
            Dec 9 '18 at 6:29
















          4












          4








          4







          Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:




          • Coordination and data fetching is distributed among several coordinators

          • Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes


          See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100






          share|improve this answer















          Using the same logic as we do for Spark, reducing the cassandra.split-size to a lower number should make you benefit from the following:




          • Coordination and data fetching is distributed among several coordinators

          • Higher concurrency of requests, which translates to a higher number of connections between the Presto node/s and Scylla nodes


          See how cassandra.split-size=1 behaves and if needed raise to 10, 50, 100







          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited Dec 2 '18 at 10:27

























          answered Dec 2 '18 at 8:33









          TomerSanTomerSan

          72519




          72519













          • @jaspreet kaur bassan - have you tried this?

            – TomerSan
            Dec 3 '18 at 8:51











          • I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

            – jaspreet kaur bassan
            Dec 9 '18 at 6:29





















          • @jaspreet kaur bassan - have you tried this?

            – TomerSan
            Dec 3 '18 at 8:51











          • I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

            – jaspreet kaur bassan
            Dec 9 '18 at 6:29



















          @jaspreet kaur bassan - have you tried this?

          – TomerSan
          Dec 3 '18 at 8:51





          @jaspreet kaur bassan - have you tried this?

          – TomerSan
          Dec 3 '18 at 8:51













          I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

          – jaspreet kaur bassan
          Dec 9 '18 at 6:29







          I never tried this on Presto. Have always used it for Spark applications. I'll try it out. Thanks

          – jaspreet kaur bassan
          Dec 9 '18 at 6:29






















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382678%2fpresto-cassandra-connector-number-of-connections%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Guess what letter conforming each word

          Port of Spain

          Run scheduled task as local user group (not BUILTIN)