Commit Graph
4875 Commits
Author SHA1 Message Date
Dean DengandgVisor bot c317e94de6 Add missing error checks for FileDescription.Init.
Syzkaller discovered this bug in pipefs by doing something quite strange:
creat(&(0x7f0000002a00)='./file1\x00', 0x0)
mount(&(0x7f0000000440)=ANY=[], &(0x7f00000002c0)='./file1\x00', &(0x7f0000000300)='devtmpfs\x00', 0x20000d, 0x0)
creat(&(0x7f0000000000)='./file1/file0\x00', 0x0)

This can be reproduced with:
touch mymount
mkfifo /dev/mypipe
mount -o ro -t devtmpfs devtmpfs mymount
echo 123 > mymount/mypipe

PiperOrigin-RevId: 349687714
2020-12-31 09:51:01 -08:00
Adin ScannellandgVisor bot 3564d5aea6 Remove remote execution support.
PiperOrigin-RevId: 349616845
2020-12-30 16:54:16 -08:00
Dean DengandgVisor bot 0672a272ab Add test for open(2) with O_WRONLY|O_RDWR.
PiperOrigin-RevId: 349607959
2020-12-30 15:22:35 -08:00
Adin ScannellandgVisor bot 2876132f6f Add BuildKite annotations for failures and profiles.
This change cleans up some minor Makefile issues, and adds support for
BuildKite annotations on failure and on profiles being generated. These
annotations will make failures very clear and link to the artifacts.

This change is a stepping stone for aggregating coverage data from all
individual test jobs, as this will also happen in .buildkite/annotate.sh.

PiperOrigin-RevId: 349606598
2020-12-30 15:09:12 -08:00
Adin ScannellandgVisor bot 57607409ea Use a stable ordering for generated types.
Otherwise this pollutes the 'go' branch and doesn't conform to standards
for generate bazel files.

PiperOrigin-RevId: 349605037
2020-12-30 14:53:03 -08:00
Fabricio VoznikaandgVisor bot dcd4e831b1 Fix condition checking in runsc debug
Closes #5052

PiperOrigin-RevId: 349579814
2020-12-30 11:18:36 -08:00
Adin ScannellandgVisor bot e691e7f098 Add continuous VFS1 tests.
PiperOrigin-RevId: 349517093
2020-12-29 23:28:39 -08:00
Ting-Yu WangandgVisor bot 7633be42a7 Deflake TestBindOverlay in //test/e2e:integration_test
Test failure happens when `echo` writes late:
* Server nc shuts down write when it sees EOF from stdin.
* Client nc closes the connection when it detects EOF from socket and no data
  in internal write buffer.

Using `-q` flag to make server not shutting down write in the beginning, while
letting connection to be closed by client. As `-q` flag's default value varies
in different netcat versions, we always specify it to prevent future breakage.

PiperOrigin-RevId: 349504016
2020-12-29 20:24:40 -08:00
Adin ScannellandgVisor bot caec235b70 Simplify profiling and benchmarks.
- Tweak the benchmarks to work with b.N where appropriate. In many cases,
  b.N was simply being ignored. This creates an implicit dependency in the
  user passing a reasonable benchtime (less than or equal to the actual
  runtime of the test, or using the X syntax) otherwise the test runs
  forever.
- In cases where the above is impossible, explicitly set benchtime from
  the test wrapper, to prevent the above behavior (tensorflow).
- Drop the *Reverse variants, which are simply hey benchmarks. We should
  just add a hey benchmark. The platforms benchmarks already include a
  native platform, and thus these benchmarks are incredibly confusing.
  (In other words, BenchmarkNginxReverse has nothing to do with an nginx
  benchmark for runsc.)
- Remove the redunant Harness object, which contains no state, in order
  to slightly simplify the code.
- Make Block and Heap profiling actually work, but setting appropriate
  runtime parameters (and plumbing them through the config).
- Split the profiling into two phases: start and stop, since some will
  need to be started early, and others will need to happen at the end.

PiperOrigin-RevId: 349495377
2020-12-29 18:29:12 -08:00
Adin ScannellandgVisor bot 5d92e45191 Exclude changing generated file from go_branch.
PiperOrigin-RevId: 349491589
2020-12-29 17:46:00 -08:00
Jing ChenandgVisor bot 9762250ce1 Deflake semaphore_test_native
PiperOrigin-RevId: 349490873
2020-12-29 17:38:23 -08:00
Adin ScannellandgVisor bot 2dd3db9918 Make profiling commands synchronous.
This allows for a model of profiling when you can start collection, and
it will terminate when the sandbox terminates. Without this synchronous
call, it is effectively impossible to collect length blocking and mutex
profiles.

PiperOrigin-RevId: 349483418
2020-12-29 16:23:01 -08:00
Tamir DubersteinandgVisor bot 0e7027a598 Export socket_ipv6_udp_unbound_loopback.cc
PiperOrigin-RevId: 349458984
2020-12-29 12:56:59 -08:00
Tamir DubersteinandgVisor bot c022b9baa7 Avoid duplicate run key
This GitHub action has been failing since 9ea89c4.

PiperOrigin-RevId: 349327675
2020-12-28 13:57:54 -08:00
gVisor bot f361d85aa7 Merge pull request #5166 from kevinGC:bk-warnings
PiperOrigin-RevId: 349314945
2020-12-28 12:12:35 -08:00
Kevin Krakauer 828818ab27 Resolve compiler warnings
The buildkite syscall tests start with a lot of C++ warnings. This
cleans that up a little.
2020-12-23 16:49:01 -08:00
Andrei VaginandgVisor bot 52f5d74eaa vfs1: don't allow to open socket files
open() has to return ENXIO in this case.

O_PATH isn't supported by vfs1.

PiperOrigin-RevId: 348820478
2020-12-23 11:11:07 -08:00
gVisor bot ca264a7ed0 Internal change.
PiperOrigin-RevId: 348720223
2020-12-22 17:46:41 -08:00
Kevin KrakauerandgVisor bot 9a19ff3525 Add missing link types to go branch
PiperOrigin-RevId: 348710397
2020-12-22 16:21:03 -08:00
Nayana BidariandgVisor bot 440e31439b Move SO_BINDTODEVICE to socketops.
PiperOrigin-RevId: 348696094
2020-12-22 14:44:02 -08:00
Tamir DubersteinandgVisor bot eb2bff384c Correctly log sniffed ARP packets
This condition was inverted in 037fba4.

PiperOrigin-RevId: 348679088
2020-12-22 12:52:19 -08:00
Peter JohnstonandgVisor bot 819c36de67 Invoke address resolution upon subsequent traffic to Failed neighbor
Removes the period of time in which subseqeuent traffic to a Failed neighbor
immediately fails with ErrNoLinkAddress. A Failed neighbor is one in which
address resolution fails; or in other words, the neighbor's IP address cannot
be translated to a MAC address.

This means removing the Failed state for linkAddrCache and allowing transitiong
out of Failed into Incomplete for neighborCache. Previously, both caches would
transition entries to Failed after address resolution fails. In this state, any
subsequent traffic requested within an unreachable time would immediately fail
with ErrNoLinkAddress. This does not follow RFC 4861 section 7.3.3:

  If address resolution fails, the entry SHOULD be deleted, so that subsequent
  traffic to that neighbor invokes the next-hop determination procedure again.
  Invoking next-hop determination at this point ensures that alternate default
  routers are tried.

The API for getting a link address for a given address, whether through the link
address cache or the neighbor table, is updated to optionally take a callback
which will be called when address resolution completes. This allows `Route` to
handle completing link resolution internally, so callers of (*Route).Resolve
(e.g. endpoints) don’t have to keep track of when it completes and update the
Route accordingly.

This change also removes the wakers from LinkAddressCache, NeighborCache, and
Route in favor of the callbacks, and callers that previously used a waker can
now just pass a callback to (*Route).Resolve that will notify the waker on
resolution completion.

Fixes #4796

Startblock:
  has LGTM from sbalana
  and then
  add reviewer ghanan
PiperOrigin-RevId: 348597478
2020-12-22 01:37:05 -08:00
Ghanan GowripalanandgVisor bot dda0b4095e Prefer matching labels and longest matching prefix
...when performing source address selection for IPv6.

These are defined in RFC 6724 section 5 rule 6 (prefer matching label)
and rule 8 (use longest matching prefix).

This change also considers ULA of global scope instead of its own scope,
as per RFC 6724 section 3.1:

   Also, note that ULAs are considered as global, not
   site-local, scope but are handled via the prefix policy table as
   discussed in Section 10.6.

Test: stack_test.TestIPv6SourceAddressSelectionScope

Startblock:
  has LGTM from peterjohnston
  and then
  add reviewer brunodalbo
PiperOrigin-RevId: 348580996
2020-12-21 22:26:10 -08:00
Andrei VaginandgVisor bot 6c6ee968a4 Don't modify a packet header when it can be used by other endpoints
Reported-by: [email protected]
PiperOrigin-RevId: 348540796
2020-12-21 15:50:33 -08:00
Kevin KrakauerandgVisor bot 4daf8b3b7b RLock Endpoint in raw.Endpoint.HandlePacket
PiperOrigin-RevId: 348530530
2020-12-21 14:44:39 -08:00
Etienne PerotandgVisor bot 13bb9e1d29 Typo fix.
PiperOrigin-RevId: 348106699
2020-12-17 15:39:03 -08:00
Chong CaiandgVisor bot 10edd10897 Set verityMu to be state nosave
PiperOrigin-RevId: 348092999
2020-12-17 14:23:02 -08:00
gVisor bot 960cef00d3 Internal change.
PiperOrigin-RevId: 348089449
2020-12-17 14:05:01 -08:00
Fabricio VoznikaandgVisor bot 2cbad081ee Set --nocache_test_results to runtime tests
If not set, the cached result is used even when runtime options
are changed, because they are not visible to blaze/bazel.

PiperOrigin-RevId: 348074339
2020-12-17 12:42:09 -08:00
Nicolas LacasseandgVisor bot dad54f748f Fix seek on /proc/pid/cmdline when task is zombie.
PiperOrigin-RevId: 348056159
2020-12-17 11:16:06 -08:00
Ayush RanjanandgVisor bot 4bc318854f [netstack] Implement IP(V6)_RECVERR socket option.
PiperOrigin-RevId: 348055514
2020-12-17 11:10:41 -08:00
Fabricio VoznikaandgVisor bot f9aad26cc4 Set process group and session on host TTY
Closes #5128

PiperOrigin-RevId: 348052446
2020-12-17 10:58:18 -08:00
Fabricio VoznikaandgVisor bot f1dad40404 Add sandbox ID to state file name
This allows to find all containers inside a sandbox more efficiently.
This operation is required every time a container starts and stops,
and previously required loading *all* container state files to check
whether the container belonged to the sandbox.

Apert from being inneficient, it has caused problems when state files
are stale or corrupt, causing inavalability to create any container.

Also adjust commands `list` and `debug` to skip over files that fail
to load.

Resolves #5052

PiperOrigin-RevId: 348050637
2020-12-17 10:52:44 -08:00
Fabricio VoznikaandgVisor bot ff7d27dfa2 Set max memory not min
Closes #5048

PiperOrigin-RevId: 348050472
2020-12-17 10:46:47 -08:00
Ayush RanjanandgVisor bot 130220dd6c [netstack] Implement MSG_ERRQUEUE flag for recvmsg(2).
Introduces the per-socket error queue and the necessary cmsg mechanisms.

PiperOrigin-RevId: 348028508
2020-12-17 08:47:24 -08:00
Tamir DubersteinandgVisor bot 2a7379a2b8 Remove duplicate return
PiperOrigin-RevId: 347974624
2020-12-17 00:40:33 -08:00
Ghanan GowripalanandgVisor bot 34fe1f8ede Cleanup locking in multicast group protocol tests
Startblock:
  has LGTM from asfez
  and then
  add reviewer tamird
PiperOrigin-RevId: 347928471
2020-12-16 17:26:06 -08:00
gVisor bot 3d92cfeaaf Automated rollback of changelist 346565589
PiperOrigin-RevId: 347911316
2020-12-16 15:41:03 -08:00
gVisor bot d12888b7db Merge pull request #4880 from lubinszARM:pr_tlbi_02
PiperOrigin-RevId: 347890782
2020-12-16 13:52:58 -08:00
Nayana BidariandgVisor bot d39ac99daa Add support to count the number of packets SACKed.
sacked_out is required in RACK to check the number of duplicate
acknowledgements during updating the reorder window. If there is no reordering
and the value for sacked_out is greater than the classic threshold value 3,
then reorder window is set to zero.
It is calculated by counting the number of segments sacked in the ACK and is
reduced when a cumulative ACK is received which covers the SACK blocks. This
value is set to zero when the connection enters recovery.

PiperOrigin-RevId: 347872246
2020-12-16 12:19:21 -08:00
Adin ScannellandgVisor bot 740b84f753 Restore refresh target.
PiperOrigin-RevId: 347864621
2020-12-16 11:45:28 -08:00
Mithun IyerandgVisor bot 310a9b5574 Ensure correctness of saved receive window
When the scaled receive window size > 65535 (max uint16), we advertise
the scaled value as 65535, but are not adjusting the saved receive
window value when doing so. This would keep our current window
calculation logic to be incorrect, as the saved receive window value
is different from what was advertised.

Fixes #4903

PiperOrigin-RevId: 347771340
release-20201216.0
2020-12-16 00:24:28 -08:00
Ghanan GowripalanandgVisor bot c4e02f5af9 Validate router alert's data length
RFC 2711 specifies that the router alert's length field is always 2
so we should make sure only 2 bytes are read from a router alert
option's data field.

Test: header.TestIPv6OptionsExtHdrIterErr
PiperOrigin-RevId: 347727876
2020-12-15 17:45:22 -08:00
Andrei VaginandgVisor bot 751466b0f9 Internal change.
PiperOrigin-RevId: 347720083
2020-12-15 16:51:35 -08:00
Ghanan GowripalanandgVisor bot 1df135aac1 Don't split enabled flag across multicast group state
Startblock:
  has LGTM from asfez
  and then
  add reviewer brunodalbo
PiperOrigin-RevId: 347716242
2020-12-15 16:28:53 -08:00
Jing ChenandgVisor bot 070e277b6e Implement command SEM_INFO and SEM_STAT for semctl.
PiperOrigin-RevId: 347711998
2020-12-15 16:06:06 -08:00
Chong CaiandgVisor bot 258ac635a9 Change violation mode to an enum
PiperOrigin-RevId: 347706953
2020-12-15 15:40:04 -08:00
Ayush RanjanandgVisor bot f28a1e36bd [syzkaller] Avoid AIOContext from resurrecting after being marked dead.
syzkaller reported the closing of a nil channel. This is only possible when the
AIOContext was destroyed twice.

Some scenarios that could lead to this:
- It died and then some called aioCtx.Prepare() on it and then killed it again
  which could cause the double destroy. The context could have been destroyed
  in between the call to LookupAIOContext() and Prepare().
- aioManager was destroyed but it did not update the contexts map. So
  Lookup could still return a dead AIOContext and then someone could call
  Prepare on it and kill it again.

So added a check in aioCtx.Prepare() for the context being dead. This will
prevent a dead context from resurrecting.
Also refactored code to destroy the aioContext consistently. Earlier we were not
munmapping the aioContexts that were destroyed upon aioManager destruction.

Reported-by: [email protected]
PiperOrigin-RevId: 347704347
2020-12-15 15:27:35 -08:00
Ayush RanjanandgVisor bot 3be1f4bb2a [netstack] Make recvmsg(2) call to host in hostinet even if dst is empty.
We want to make the recvmsg syscall to the host regardless of if the dst is
empty or not so that:
- Host can populate the control messages if necessary.
- Host can return sender address.
- Host can return appropriate errors.

Earlier because we were using the IOSequence.CopyOutFrom() API, the usermem
package does not even call the Reader function if the destination is empty (as
an optimization).

PiperOrigin-RevId: 347684566
2020-12-15 13:48:33 -08:00
gVisor bot 0b9cb83699 Internal change.
PiperOrigin-RevId: 347671070
2020-12-15 12:41:02 -08:00