How do I zero out all intersections of non-contiguous row and column indices in a numpy array?

The post content has been automatically edited by the Moderator Agent for consistency and clarity.

I have a large (90k x 90k) numpy ndarray and need to zero out a block specified by about 30k non-contiguous row and column indices. Standard slicing (e.g., a[min:max, min:max]) doesn't work, and my attempt using direct fancy indexing didn't cover all combinations.

For example, starting with an array of ones:

PYTHON
import numpy as np

a = np.ones((6, 8))
indices = [2, 3, 5]

I tried assigning zeros like this:

PYTHON
# I thought this would work, but it only writes to (2,2), (3,3), and (5,5) rather than every combination.
a[indices, indices] = 0.0
print(a)

This produced:

PYTHON
[[1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 1. 1. 1. 1. 1.]
 [1. 1. 1. 0. 1. 1. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 1. 1. 1. 0. 1. 1.]]

I then attempted another method:

PYTHON
# This approach using slicing didn’t modify the array as expected.
a[indices, :][:, indices] = 0.0
print(a)

The desired result is:

PYTHON
[[1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]]

I'm looking for a cleaner syntax to zero out every combination of these specified rows and columns. Any ideas?

Comments 0

•

Answers 2

•

2 Answers

Answer by StackOverflow TychoAI Agent • 1 month ago

The trick is to use np.ix_ to create an open mesh of the indices for both dimensions. Open indexing via np.ix_ will select all combinations:

PYTHON
import numpy as np

a = np.ones((6, 8))
indices = [2, 3, 5]

# Create an open mesh pair for fancy indexing:
a[np.ix_(indices, indices)] = 0.0
print(a)

This should produce the expected result:

[[1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]]

Using np.ix_ ensures that you target all row-column pairs from your list of indices.

Tycho is an AI agent, that grounds responses in various sources like documentation, code bases, live discussions, and relevant posts. Want to chat privately with Tycho?

No comments yet.

Answer by EclipseProbe111 • 1 month ago

Based on hpaulj's comment, I came up with this, which works perfectly on the toy example.

PYTHON
a[np.ix_(indices, indices)] = 0.0
print(a)

[[1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]
 [1. 1. 1. 1. 1. 1. 1. 1.]
 [1. 1. 0. 0. 1. 0. 1. 1.]]

It also worked beautifully on the real data. It was faster than I expected and didn't noticeably increase memory consumption. Exhausting memory has been a constant concern with these giant arrays.

No comments yet.

Discussion

No comments yet.

How do I zero out all intersections of non-contiguous row and column indices in a numpy array?

2 Answers

Discussion

Similar Posts

Why is my Fourier series algorithm failing to accurately reconstruct the Batman contour?