protocol buffers - Should I use a binary or a text file for storing protobuf messages? -

-

Using Google protobuf, I am saving my sorted messages in a file - there are many messages in each file. I have the code of C ++ and Python versions, so I need to use the protocol function that Available in both languages I have experimented with using SerializeToArray and SerializeAsString and here are the following unfortunate conditions:

  1. Serialize Other: As one answer suggests, the best way to use it The way to prefix each message, with its data size, it will work very well for C ++, but this does not look like Python - am I wrong?

  2. SerialistString: This creates a serial string equal to the binary equivalent - which I can save in a file, but what happens if the serialization result is one of the characters \ n - How do we find the end of the line, or the closing of the messages for that matter?

Update:

Please refresh me a bit. As I understand it, I can not write binary data in C ++ because since then our Python can not read application data, since it can only parse stringed serialized messages. Should I use SerializeAsString in both C ++ and Python instead? If so, is it the best practice to store such a data in a text file instead of a binary file? My intestine sense is binary, but as you can see it does not seem to be an option.

The best practice to add messages in this way is to fill each message with its size In this way you read in size (try 32 bit int or anything else), then read the number of those bytes in the buffer, horizontally, then read the next size, etc.

The same goes for writing, you first write the size of the message, then the message itself.

See on Protobf documentation for more information.


Comments

Post a Comment

Popular posts from this blog

c# - How to capture HTTP packet with SharpPcap -

-
I would like to capture all incoming HTTP packets on my machine. To do this, I am using SharpPcap which is a WinPcap The cover is. SharpPcap works very well, but it captures TCP packets and what it wants to do for me is a very low level. Does anyone know how can I easily get full HTTP requests / reactions from all these TCP packets? Thanks SharpPcap is already able to capture the packet in the same way That's what the virus does (just in the code instead of the GUI). And you can either either parse them directly or you can put them in the drive in the common .pcap file format. The steps to parse the capture are: Open a connection at any time Loop a while Or start capturing using an event callback Parsing the raw packet for the type you want If you are reading .PPP dump files In addition to calling you an offline capture reader is almost the same, there is no need to select an interface, and you can set the majority There is no need to do the modes. All st...
Read more

php - Multiple Select with Explode: only returns the word "Array" -

-
By using Wordpress I have created a multiple selection box so that users can select categories to exclude. When the page is initially loaded, I see my predefined default option. However, when I select a new value and I save ... I only see the word "Array" and have not chosen anything else? & lt; Class = "amultiple" id = "& lt; php echo $ value ['id'] ;? gt;" name = "& gt; php echo $ value ['id'] ;; gt; []" Multiple = "multiple" size = "8" & gt; & Lt ;? Php global option; Foreign currency ($ value as value $) {if (get_settings ($ value ['id']) === FALSE {$$ value ['id'] = $ value ['std']; } And {$$ value ['id'] = get_settings ($ value ['id']); }} $ Ranges = & amp; Amp; Categories ('type = post & orderbiz = name & amp; hide_empty = 1'); If ($ ranges) {$ ex_cat = implode (',', $ tt_cat_exclude); Forex Currency ($ range a...
Read more

php - jQuery AJAX Post not working -

-
I do not understand why this script does not work. It has something to do within AJAX PostScript / Function. Right now, when I submit my form, it runs php code on the same page. What it should do, send the values ​​of the form for Project_Azax.fp, then there will be a refund of success on the page which is correct or false. $ (document) .ready (function () {$ ('div # didIt'). Hide (); $ ('form [name = adminForm]'). Submit (function () ($ {'.post' ('/ project_ajax.php', {action: $ ('[name = action]') Val (), pId: $ ('[name = pId]'). Val (), name ('[Name = name]'. Val (), url: $ ('[url = url]'). Val (), summary: ('[summary = summary]'). Val ()}, Function (data) {if (data.success) {$ ('div # didIt') .Sliddown ('slow');} and {warning ('unsuccessful SA!');}}, 'Jason'); return false ;});}); What is the code for project_ajax.php below ... if ($ _ POST ['action'] == ...
Read more