Go - 如何将包含十六进制字符的txt文件解码/转换为可读字符串

时间:2021-01-14 18:11:59

I've got a log file, where each line is a JSON. Due to some Nginx security reasons, the logs are being saved in a hexadecimal format (e.g. the char " will be converted to \x22). Here is an example of a JSON line:

我有一个日志文件,其中每一行都是JSON。由于一些Nginx安全原因,日志以十六进制格式保存(例如,char“将转换为\ x22)。以下是JSON行的示例:

 { "body_bytes_sent": "474", "params": {\x22device_id\x22: \x221234567890\x22} }

My goal:

我的目标:

  1. Read the file line by line.
  2. 逐行读取文件。
  3. Convert each line to a readable format

    将每一行转换为可读格式

    { "body_bytes_sent": "474", "params" : {"device_id": "1234567890"} }
    
  4. Convert this string into a JSON object so I could manipulate it.

    将此字符串转换为JSON对象,以便我可以操作它。

Any help will be appreciated.

任何帮助将不胜感激。

1 个解决方案

#1


4  

You can use strconv.Unquote to convert the string to a normal one:

您可以使用strconv.Unquote将字符串转换为普通字符串:

package main

import (
    "encoding/json"
    "fmt"
    "strconv"
)

func main() {

    // this is what your input string looks like...
    qs := "{\\x22device_id\\x22: \\x221234567890\\x22}"

    // now let's convert it to a normal string
    // note that it has to look like a Go string literal so we're
    // using Sprintf
    s, err := strconv.Unquote(fmt.Sprintf(`"%s"`, qs))
    if err != nil {
        panic(err)
    }
    fmt.Println(s)

    // just for good measure, let's see if it can actually be decoded.
    // SPOILER ALERT: It decodes just fine!
    var v map[string]interface{}
    if err := json.Unmarshal([]byte(s), &v); err != nil {
        panic(err)

    }
    fmt.Println(v)
}

Playground

操场

#1


4  

You can use strconv.Unquote to convert the string to a normal one:

您可以使用strconv.Unquote将字符串转换为普通字符串:

package main

import (
    "encoding/json"
    "fmt"
    "strconv"
)

func main() {

    // this is what your input string looks like...
    qs := "{\\x22device_id\\x22: \\x221234567890\\x22}"

    // now let's convert it to a normal string
    // note that it has to look like a Go string literal so we're
    // using Sprintf
    s, err := strconv.Unquote(fmt.Sprintf(`"%s"`, qs))
    if err != nil {
        panic(err)
    }
    fmt.Println(s)

    // just for good measure, let's see if it can actually be decoded.
    // SPOILER ALERT: It decodes just fine!
    var v map[string]interface{}
    if err := json.Unmarshal([]byte(s), &v); err != nil {
        panic(err)

    }
    fmt.Println(v)
}

Playground

操场