# Dropped data

**URL:** https://community.zeek.org/t/dropped-data/5288
**Category:** Zeek
**Created:** [May 2, 2018, 8:13pm UTC](https://community.zeek.org/t/dropped-data/5288 "2018-05-02T20:13:07Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![Carl\_Rotenan](https://avatars.discourse-cdn.com/v4/letter/c/d78d45/32.png) [@Carl\_Rotenan](https://community.zeek.org/u/Carl_Rotenan)
#### Post date: [May 2, 2018, 8:13pm UTC](https://community.zeek.org/t/dropped-data/5288/1 "2018-05-02T20:13:07Z")

</div>

Hello,

Can someone give me some direction on trying to figure out why I have dropped data?

This output is from a machine getting about 3G of traffic a minute or so into starting Bro 2.5.3 with PF\_RING 7.0.0.

How much data per worker should I expect to budget for? Ideally I’d like Bro to be able to do 10G of traffic.

Has anyone used PF\_RING ZC with success?

worker-0-1: 1525291681.760081 recvd=564836 dropped=0 link=564836  
worker-0-2: 1525291681.961074 recvd=723187 dropped=0 link=723187  
worker-0-3: 1525291682.162178 recvd=682598 dropped=4619 link=682598  
worker-0-4: 1525291682.364202 recvd=1094776 dropped=0 link=1094776  
worker-0-5: 1525291682.566055 recvd=6722748 dropped=30902 link=6722748  
worker-0-6: 1525291682.768050 recvd=2180528 dropped=0 link=2180528  
worker-0-7: 1525291682.969023 recvd=3252824 dropped=0 link=3252824  
worker-0-8: 1525291683.179065 recvd=414112 dropped=0 link=414112  
worker-0-9: 1525291683.379083 recvd=2228892 dropped=52543 link=2228892  
worker-0-10: 1525291683.579973 recvd=1735298 dropped=0 link=1735298  
worker-0-11: 1525291683.780260 recvd=2720785 dropped=1437 link=2720785  
worker-0-12: 1525291683.981421 recvd=5835651 dropped=7610 link=5835651  
worker-0-13: 1525291684.181057 recvd=566766 dropped=0 link=566766  
worker-0-14: 1525291684.381979 recvd=335114 dropped=0 link=335114  
worker-0-15: 1525291684.582077 recvd=743998 dropped=0 link=743998  
worker-0-16: 1525291684.782897 recvd=6124252 dropped=54604 link=6124252  
worker-0-17: 1525291684.980916 recvd=3476401 dropped=17138 link=3476401  
worker-0-18: 1525291685.184047 recvd=1286574 dropped=0 link=1286574

---

<div class="post-metadata">

### Author: ![johanna](https://avatars.discourse-cdn.com/v4/letter/j/50afbb/32.png) [@johanna](https://community.zeek.org/u/johanna)
#### Post date: [May 9, 2018, 12:17am UTC](https://community.zeek.org/t/dropped-data/5288/2 "2018-05-09T00:17:11Z")

</div>

Hi,

this actually does not look very bad to me - on most interfaces you do not  
seem to have any drops. One of them has a bit over 2% which is not that  
pretty but also not catastrophic.

I have no experience with ZC, but generally packet loss can be caused by a  
number of issues. Single high-speed connections can be problematic  
(because they add to the normal load of a single Bro process). Microbursts  
also happen and can lead to a bit of packet loss.

If there is a setting to increase the available buffer, that might be  
worth playing around with.

Johanna

---

<div class="post-metadata">

### Author: ![Michal\_Purzynski1](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@Michal\_Purzynski1](https://community.zeek.org/u/Michal_Purzynski1)
#### Post date: [May 9, 2018, 1:20am UTC](https://community.zeek.org/t/dropped-data/5288/3 "2018-05-09T01:20:08Z")

</div>

What kind of cards and distribution do you have? Maybe you could just switch to afpacket to avoid the problem entirely

---

<div class="post-metadata">

### Author: ![Carl\_Rotenan](https://avatars.discourse-cdn.com/v4/letter/c/d78d45/32.png) [@Carl\_Rotenan](https://community.zeek.org/u/Carl_Rotenan)
#### Post date: [May 10, 2018, 12:45pm UTC](https://community.zeek.org/t/dropped-data/5288/4 "2018-05-10T12:45:19Z")

</div>

Michal,

Could you explain what you meant by switching to AF\_PACKET and avoiding the problem all together?

Thanks,

Carl

---

<div class="post-metadata">

### Author: ![Michal\_Purzynski1](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@Michal\_Purzynski1](https://community.zeek.org/u/Michal_Purzynski1)
#### Post date: [May 11, 2018, 8:32am UTC](https://community.zeek.org/t/dropped-data/5288/5 "2018-05-11T08:32:42Z")

</div>

There’s no advantage using crazy solutions that make you jump through multiple hoops when most of the time the default and built in packet capture mechanism works well.

---

<div class="post-metadata">

### Author: ![seth](https://yyz1.discourse-cdn.com/flex011/user_avatar/community.zeek.org/seth/32/642_2.png) [@seth](https://community.zeek.org/u/seth)
#### Post date: [May 14, 2018, 2:28pm UTC](https://community.zeek.org/t/dropped-data/5288/6 "2018-05-14T14:28:49Z")

</div>

I think he may have been looking for pointers to a next step to take. 🙂

Carl, I think Michal might be telling you to look into the AF\_Packet plugin by Jan Grashofer…  
[https://github.com/J-Gras/bro-af\_packet-plugin](https://github.com/J-Gras/bro-af_packet-plugin)

That page has full instructions on how to install and use the plugin.

.Seth

---

<div class="post-metadata">

### Author: ![system](https://canada1.discourse-cdn.com/flex011/uploads/zeek/original/1X/f09d732bc2cc7c7cc7e35db67cf4e1d5233ce7a7.png) [@system](https://community.zeek.org/u/system)
#### Post date: [May 6, 2022, 3:45pm UTC](https://community.zeek.org/t/dropped-data/5288/7 "2022-05-06T15:45:45Z")

</div>


