Level 2
I suggest you to convert the JSON data in a collection and then manipulate it with collection's methods:
$collection = collect(json_decode($jsonData, true));
this works if the incoming data is a well formed JSON
1 like
Mar 15, 2023
3
Level 1
How to efficiently handle and filter large amounts of data from API for user profiles?
I are working with a third-party API that provides me with account's profile data. Unfortunately, The data you receive is very much information. This makes it difficult to efficiently process and use the data.
Any suggestions on how to efficiently filter and process the data with format like below. This is not full data i received from API.
{
"member_subject_id": 1,
"member_subject_section": "top",
"children": [],
"member_items": [
{
"member_item_id": 1,
"member_subject_id": 1,
"member_item_input": "top_image",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 2,
"member_subject_id": 1,
"member_item_input": "top_goal",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": "f"
},
{
"member_item_id": 3,
"member_subject_id": 1,
"member_item_input": "top_dream",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 152,
"member_subject_id": 1,
"member_item_input": "top_target_select",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 153,
"member_subject_id": 1,
"member_item_input": "top_goal_study",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 154,
"member_subject_id": 1,
"member_item_input": "top_achievement_date",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": "2023-01-31"
},
{
"member_item_id": 155,
"member_subject_id": 1,
"member_item_input": "top_goal_career",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 156,
"member_subject_id": 1,
"member_item_input": "top_hajl_achievement_date",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 157,
"member_subject_id": 1,
"member_item_input": "top_hlzen_achievement_date",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
}
]
},
{
"member_subject_id": 2,
"member_subject_section": "basic",
"children": [],
"member_items": [
{
"member_item_id": 4,
"member_subject_id": 2,
"member_item_input": "basic_facebook",
"member_is_public": 1,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 5,
"member_subject_id": 2,
"member_item_input": "basic_linkedin",
"member_is_public": 1,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 6,
"member_subject_id": 2,
"member_item_input": "basic_instagram",
"member_is_public": 1,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 7,
"member_subject_id": 2,
"member_item_input": "basic_twitter",
"member_is_public": 1,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 8,
"member_subject_id": 2,
"member_item_input": "basic_line",
"member_is_public": 1,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 151,
"member_subject_id": 2,
"member_item_input": "basic_tel",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 158,
"member_subject_id": 2,
"member_item_input": "basic_name",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 159,
"member_subject_id": 2,
"member_item_input": "basic_kananame",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 160,
"member_subject_id": 2,
"member_item_input": "basic_romaname",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 161,
"member_subject_id": 2,
"member_item_input": "basic_mailadd",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 162,
"member_subject_id": 2,
"member_item_input": "basic_birthday",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 163,
"member_subject_id": 2,
"member_item_input": "basic_gender",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 164,
"member_subject_id": 2,
"member_item_input": "basic_zip",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 165,
"member_subject_id": 2,
"member_item_input": "basic_address1",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 166,
"member_subject_id": 2,
"member_item_input": "basic_address2",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 167,
"member_subject_id": 2,
"member_item_input": "basic_address3",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
},
{
"member_item_id": 168,
"member_subject_id": 2,
"member_item_input": "basic_member_tel",
"member_is_public": 0,
"member_kind": "mk_stu",
"is_required": 0,
"is_public": "",
"item_value": ""
}
]
},
Level 1
My challenge is that I need to maintain a data structure in order to send update requests to an API. However, this data structure contains a lot of information that I don't need for my application. Despite this, I must still include the entire data structure when sending update requests to the API.
Level 2
@andkk you should be more specific, providing some example. Anyway if you have to keep all the data to send the update, i think that you can't discard nothing :-|
1 like
Please or to participate in this conversation.