Avoiding unpacking an array when altering its dimension












2












$begingroup$


I am trying to flatten a matrix from 3-dimensional to 2-dimensional one.



The original one has dimension for example {10,120,120}:



list1 = RandomReal[1, {10, 120, 120}];


I want to convert it to a new matrix with {10,120*120} dimension. I am using:



On["Packing"]  (*For checking if exist unpacked arrays *)  

Flatten[Map[Flatten, {list1}, {-3}], 1];


But this will generate unpacked array. How should I avoid this issue?






list-manipulation packed-arrays







share|improve this question











$endgroup$








  • 2




    $begingroup$
    Try Flatten[list1, {{1}, {2, 3}}].
    $endgroup$
    – J. M. is computer-less♦
    2 hours ago










  • $begingroup$
    Thanks, it works!
    $endgroup$
    – cj9435042
    2 hours ago










  • $begingroup$
    Flatten /@ list1
    $endgroup$
    – Okkes Dulgerci
    1 hour ago
















2












$begingroup$


I am trying to flatten a matrix from 3-dimensional to 2-dimensional one.



The original one has dimension for example {10,120,120}:



list1 = RandomReal[1, {10, 120, 120}];


I want to convert it to a new matrix with {10,120*120} dimension. I am using:



On["Packing"]  (*For checking if exist unpacked arrays *)  

Flatten[Map[Flatten, {list1}, {-3}], 1];


But this will generate unpacked array. How should I avoid this issue?






list-manipulation packed-arrays







share|improve this question











$endgroup$








  • 2




    $begingroup$
    Try Flatten[list1, {{1}, {2, 3}}].
    $endgroup$
    – J. M. is computer-less♦
    2 hours ago










  • $begingroup$
    Thanks, it works!
    $endgroup$
    – cj9435042
    2 hours ago










  • $begingroup$
    Flatten /@ list1
    $endgroup$
    – Okkes Dulgerci
    1 hour ago














2












2








2





$begingroup$


I am trying to flatten a matrix from 3-dimensional to 2-dimensional one.



The original one has dimension for example {10,120,120}:



list1 = RandomReal[1, {10, 120, 120}];


I want to convert it to a new matrix with {10,120*120} dimension. I am using:



On["Packing"]  (*For checking if exist unpacked arrays *)  

Flatten[Map[Flatten, {list1}, {-3}], 1];


But this will generate unpacked array. How should I avoid this issue?






list-manipulation packed-arrays







share|improve this question











$endgroup$




I am trying to flatten a matrix from 3-dimensional to 2-dimensional one.



The original one has dimension for example {10,120,120}:



list1 = RandomReal[1, {10, 120, 120}];


I want to convert it to a new matrix with {10,120*120} dimension. I am using:



On["Packing"]  (*For checking if exist unpacked arrays *)  

Flatten[Map[Flatten, {list1}, {-3}], 1];


But this will generate unpacked array. How should I avoid this issue?






list-manipulation packed-arrays




list-manipulation packed-arrays






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited 1 hour ago









m_goldberg

87.2k872197




87.2k872197










asked 2 hours ago









cj9435042cj9435042

35416




35416








  • 2




    $begingroup$
    Try Flatten[list1, {{1}, {2, 3}}].
    $endgroup$
    – J. M. is computer-less♦
    2 hours ago










  • $begingroup$
    Thanks, it works!
    $endgroup$
    – cj9435042
    2 hours ago










  • $begingroup$
    Flatten /@ list1
    $endgroup$
    – Okkes Dulgerci
    1 hour ago














  • 2




    $begingroup$
    Try Flatten[list1, {{1}, {2, 3}}].
    $endgroup$
    – J. M. is computer-less♦
    2 hours ago










  • $begingroup$
    Thanks, it works!
    $endgroup$
    – cj9435042
    2 hours ago










  • $begingroup$
    Flatten /@ list1
    $endgroup$
    – Okkes Dulgerci
    1 hour ago








2




2




$begingroup$
Try Flatten[list1, {{1}, {2, 3}}].
$endgroup$
– J. M. is computer-less♦
2 hours ago




$begingroup$
Try Flatten[list1, {{1}, {2, 3}}].
$endgroup$
– J. M. is computer-less♦
2 hours ago












$begingroup$
Thanks, it works!
$endgroup$
– cj9435042
2 hours ago




$begingroup$
Thanks, it works!
$endgroup$
– cj9435042
2 hours ago












$begingroup$
Flatten /@ list1
$endgroup$
– Okkes Dulgerci
1 hour ago




$begingroup$
Flatten /@ list1
$endgroup$
– Okkes Dulgerci
1 hour ago










1 Answer
1






active

oldest

votes


















5












$begingroup$

An alternative to using Flatten as in the comments is to use ArrayReshape. For large arrays, ArrayReshape should be significantly faster. For example:



list1 = RandomReal[1, {10, 1200, 1200}];


Comparison:



r1 = Flatten[list1, {{1}, {2, 3}}]; //RepeatedTiming

r2 = ArrayReshape[list1, {10, 1200 1200}]; //RepeatedTiming



r1 === r2



{0.120, Null}



{0.025, Null}



True







share|improve this answer









$endgroup$













  • $begingroup$
    I'm too slow..... :)
    $endgroup$
    – Michael E2
    2 hours ago











Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "387"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathematica.stackexchange.com%2fquestions%2f192623%2favoiding-unpacking-an-array-when-altering-its-dimension%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









5












$begingroup$

An alternative to using Flatten as in the comments is to use ArrayReshape. For large arrays, ArrayReshape should be significantly faster. For example:



list1 = RandomReal[1, {10, 1200, 1200}];


Comparison:



r1 = Flatten[list1, {{1}, {2, 3}}]; //RepeatedTiming

r2 = ArrayReshape[list1, {10, 1200 1200}]; //RepeatedTiming



r1 === r2



{0.120, Null}



{0.025, Null}



True







share|improve this answer









$endgroup$













  • $begingroup$
    I'm too slow..... :)
    $endgroup$
    – Michael E2
    2 hours ago
















5












$begingroup$

An alternative to using Flatten as in the comments is to use ArrayReshape. For large arrays, ArrayReshape should be significantly faster. For example:



list1 = RandomReal[1, {10, 1200, 1200}];


Comparison:



r1 = Flatten[list1, {{1}, {2, 3}}]; //RepeatedTiming

r2 = ArrayReshape[list1, {10, 1200 1200}]; //RepeatedTiming



r1 === r2



{0.120, Null}



{0.025, Null}



True







share|improve this answer









$endgroup$













  • $begingroup$
    I'm too slow..... :)
    $endgroup$
    – Michael E2
    2 hours ago














5












5








5





$begingroup$

An alternative to using Flatten as in the comments is to use ArrayReshape. For large arrays, ArrayReshape should be significantly faster. For example:



list1 = RandomReal[1, {10, 1200, 1200}];


Comparison:



r1 = Flatten[list1, {{1}, {2, 3}}]; //RepeatedTiming

r2 = ArrayReshape[list1, {10, 1200 1200}]; //RepeatedTiming



r1 === r2



{0.120, Null}



{0.025, Null}



True







share|improve this answer









$endgroup$



An alternative to using Flatten as in the comments is to use ArrayReshape. For large arrays, ArrayReshape should be significantly faster. For example:



list1 = RandomReal[1, {10, 1200, 1200}];


Comparison:



r1 = Flatten[list1, {{1}, {2, 3}}]; //RepeatedTiming

r2 = ArrayReshape[list1, {10, 1200 1200}]; //RepeatedTiming



r1 === r2



{0.120, Null}



{0.025, Null}



True








share|improve this answer












share|improve this answer



share|improve this answer










answered 2 hours ago









Carl WollCarl Woll

69k391177




69k391177












  • $begingroup$
    I'm too slow..... :)
    $endgroup$
    – Michael E2
    2 hours ago


















  • $begingroup$
    I'm too slow..... :)
    $endgroup$
    – Michael E2
    2 hours ago
















$begingroup$
I'm too slow..... :)
$endgroup$
– Michael E2
2 hours ago




$begingroup$
I'm too slow..... :)
$endgroup$
– Michael E2
2 hours ago


















draft saved

draft discarded




















































Thanks for contributing an answer to Mathematica Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathematica.stackexchange.com%2fquestions%2f192623%2favoiding-unpacking-an-array-when-altering-its-dimension%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

SQL Server 17 - Attemping to backup to remote NAS but Access is denied

Image
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0; } 0 I was attemping to use Ola Hallengrens scripts to backup to a remote NAS, but it was failing and not giving any direct errors, so I tried doing it manually using Server Management Studio and got the following error: TITLE: Microsoft SQL Server Management Studio Failed to retrieve data for this request. (Microsoft.SqlServer.Management.Sdk.Sfc) For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%20SQL%20Server&LinkId=20476 ADDITIONAL INFORMATION: An exception occurred while executing a Transact-SQL statement or batch. (Microsoft.SqlServer.ConnectionInfo) The operating system returned the error '0x80070005(Access is denied.)&#
Read more

Always On Availability groups resolving state after failover - Remote harden of transaction...

Image
0 My explanation will be opinion based as it is based on my findings. If more information is needed, I am always happy to add it. The setup We have 4 SQL Server 2016 Instances, and all 4 underlying servers are in a WSFC (In my eyes a strange setup since Always On AG's are 2 by 2. But that is a different question.) 4 nodes + Fileshare witness Version: 13.0.5026.0 (all nodes) The instances that are having the failover issues are instances 1 & 2. They have 3 AG's between them. AG1 is primary on instance 1 and is having the issue. AG2 and AG3 are primary on instance 2. Instances 3 and 4 have their own separate AG's (2). AG1's settings The week before Last week, after checking for long running queries (none) and the synchronization state (green accross the board) we initiated a
Read more

Restoring from pg_dump with foreign key constraints

Image
5 2 In restoring a database from a pg_dump , a number of errors are being generated and the whole table is subsequently being ignored. An example: ERROR: insert or update on table "channelproducts" violates foreign key constraint "fk_rails_dfaae373a5" DETAIL: Key (channel_id)=(1) is not present in table "channels". Interestingly enough, I've noted that all these instances are popping up because of the sequence of loading. channels is after channelproducts both alphabetically and in the file and thus I can understand why postgres complains about having to create a child without a parent. caveat: the foreign key is being generated automatically by rails 4.2: I could remove the problem at the source but that still does not really solve the problem... version: PostgreSQL
Read more