Updating many json files in Azure blob storage? -

-

I have ~ 1,000,000 JSON files, I would like to update every 30 minutes. Update is only enclosing a new array at the end of the existing content.

Uses the same code as a single update: 

  CloudBlockBlob blockBlob = container.GetBlockBlobReference (blobName); Jobbject jObject = null; // If the blob is present, then we may need to update it. If (blockBlob.Exists ()) {MemoryStream memoryStream = new MemoryStream (); BlockBlob.DownloadToStream (MemoryStream); JObject = JsonConvert.DeserializeObject (encoding.UTF8.GetString (MemoryStream. ToArray ()) functioning; } // End of Blease is present if (null == jObject) {jObject = new Jobbject (); JObject.Add (new JProperty ("identifier", identifier)); } // Closing of the block did not exist JArray jsonArray = new JArray (); JObject.Add (New JProperty (string.Format ("Entries {0}", Timestamp. ToString ()), jsonArray); Foreign Currency (Miscellaneous Entries in New Entry) {JSNARRA.ed (new JobTech (new JPPrint ("Some ID", Entry.), New JProperty ("Some Value", Value)); } // the end of the loop string jsonString = JsonConvert.SerializeObject (jObject); // upload blockblock Properties Type Content = "Text / Jason"; Blockblock UploadFomstream (new memorystream (encoding.utf 8.gatebites (jasonstring)); Basically:  
     
  1.  Check if the blob exists,  
  2.  If this happens, download the data and create a Jason object.  
  3.  If it has not, create a new object with the details.  
  4.  Push the blob update.   
     Problems with it is performance demonstrations I have done a lot that I can do to increase the performance (updates run in five parallel threads and I use  ServicePointManager.UseNagleAlgorithm  Is set to false. 
     
     It still runs at a slow pace, however, approximately 100,000 updates can take up to one hour. 
     
     So I was basically guessed , My question will be: 
     
       
    1.  Do I use blue blob for this 
      2.  
    2.  If yes, any suggestion for improving performance? 
      3.  
     
     Note: the original in the file There is a history of events and I can not re-generate the full file based on the existing data. Therefore, content is downloaded prior to updating.


Comments

Post a Comment

Popular posts from this blog

java - Can't add JTree to JPanel of a JInternalFrame -

-
Image
There are two panels in my JInternalframe. I want to add TopPanel to Jtree to nominate another. But I can not add Jaitari to the top of the panel. Please help me in this piece of code: DefaultMutableTreeNode root = new DefaultMutableTreeNode ("deck"); DefaultMutableTreeNode Item Clubs = New DefaultMutableTreeNode ("Club"); AddAllCard (itemClubs); Root.add (itemClubs); DefaultMutableTreeNode item = New DefaultMutableTreeNode ("Diamonds"); AddAllCard (itemDiamonds); Root.add (itemDiamonds); DefaultMutableTreeNode Itemspads = New DefaultMutableTreeNode ("Spades"); AddAllCard (itemSpades); Root.add (itemSpades); DefaultMutableTreeNode item increases = new DefaultMutableTreeNode ("heart"); AddAllCard (itemHearts); Root.add (itemHearts); Default Trimodel Tree Model = New DefaultTreeModel (Route); Tree = new jetty (tree modal); ScrollPane = new JScrollPane (tree); // scrollPane.setViewportView (tree); . ScrollPane.getViewport () add (tr
Read more

javascript - data.match(var) not working it seems -

-
OK, I have this small block code, which is to scanned a number on the website, but for some reason There is a hip that it is not scanning at all. var regenges = / \ & lt; Span class = "currency-robux" data-to-"item-private-value-price" & gt; ([\ D,]) \ & LT; \ / Span \ & gt; /; Var ValueCiling = Data. Match (reggae); Value-song = number (value slicing location (",", "")); Is there anything wrong with that? This is related to the if statement if (value sling and lieutenant; = price watching) { < P> A function calls to move from there, but for some reason it does not seem to run at all. So I think the Regex is wrong but I'm not sure how. (There is a variable in PriceWinking , this is a snippet from the code.) On the website, I'm trying to remove it. & lt; Span class = "robux" data-plus = "item-privatesale-price" & gt; 115 & lt; / Span & gt; Keep in mind
Read more

javascript - How can I pause a jQuery .each() loop, while waiting for user input? -

-
Before I continue to get a jQuery .each loop to wait for user input There is a problem in repeatedly repeating This is my code (I have commented on what I would like to do): & lt; Html xmlns = "http://www.w3.org/1999/xhtml" & gt; & Lt; Top & gt; & Lt; Link rel = "stylesheet" type = "text / css" href = "common_components.css" /> & Lt; Meta http-equiv = "content-type" content = "text / html; charset = UTF-8" /> & Lt; Link rel = "stylesheet" href = "slider.css" & gt; & Lt ;? Php include_once 'common_components.php'; $ Query = $ dbh- & gt; Queries ("SELECT movies_dir FROM settings"); $ Line = $ query- & gt; Obtain (PDO :: FETCH_ASSOC); Date_default_timezone_set ('UTC'); Echo "& lt; title & gt; movie scanner & lt; / title & gt;"; ? & Gt; & Lt; Script src = "jquery.min.js" & gt; &am
Read more