文件格式如下,多个dict拼起来的,中间也没有逗号或者中括号括起来,如何读取转化为单个dict?

{

    "lr": 0.01,

    "data_time": 3.05494966506958,

    "loss": 0.6787786483764648,

    "accuracy_top-1": 47.916664123535156,

    "time": 4.566040325164795,

    "epoch": 1,

    "iter": 10,

    "memory": 21963,

    "step": 10

}

{

    "lr": 0.01,

    "data_time": 0.7254947900772095,

    "loss": 0.6653209626674652,

    "accuracy_top-1": 41.666664123535156,

    "time": 1.9487781286239625,

    "epoch": 1,

    "iter": 20,

    "memory": 21963,

    "step": 20

}

...

python实现如下,每个字典都保存在log里,可以自行保存:

with open(json_log, 'r') as log_file:
    single_log = ""
    for line in log_file:
        try:
            single_log += line.strip()
            single_log = single_log.replace("\'", "\"")
            log = json.loads(single_log)
        except Exception as e:
            continue
        single_log = ""
        print(log)

Logo

腾讯云面向开发者汇聚海量精品云计算使用和开发经验,营造开放的云计算技术生态圈。

更多推荐