Skip to content

/ srs

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

用DJI GO推流到SRS,RTMP播放正常，HLS无法播放 #635

Closed
xiaoyaowx opened this issue Aug 29, 2016 · 13 comments
Closed

用DJI GO推流到SRS,RTMP播放正常，HLS无法播放 #635

xiaoyaowx opened this issue Aug 29, 2016 · 13 comments
Labels
Bug
Milestone
srs 2.0 release

Comments

@xiaoyaowx
Copy link

@xiaoyaowx xiaoyaowx commented Aug 29, 2016

用“DJI GO”（大彊无人机的APP）推流到SRS,RTMP播放正常，HLS无法播放，视频全是马赛克。同时测试推流到wowza服务器，wowoza上面生成的hls播放是正常的，请问这是什么原因？
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Sep 9, 2016

开启atc模式，用srs rtmp dump录制一段flv，把日志和文件传上来看看。
记得不要弄错了，错了数据是不对的。
@xiaoyaowx
Copy link
Author

@xiaoyaowx xiaoyaowx commented Dec 8, 2016

[2016-12-08 10:26:36.416][trace][13946][227] dvr stream wifiwx-85 to file /storage/live_data/live/wifiwx-85.1481163996416.flv
[2016-12-08 10:26:36.426][trace][13946][227] set TCP_NODELAY 0=>1
[2016-12-08 10:26:36.427][trace][13946][227] start publish mr=0/350, p1stpt=20000, pnt=20000, tcp_nodelay=1, rtcid=230
[2016-12-08 10:26:36.530][trace][13946][227] got metadata, width=960, height=720, vcodec=7, acodec=10
[2016-12-08 10:26:36.530][trace][13946][227] 42B video sh, codec(7, profile=Baseline, level=3.1, 960x720, 0kbps, 0fps, 0s)
[2016-12-08 10:26:36.530][trace][13946][227] 7B audio sh, codec(10, profile=LC, 1channels, 0kbps, 44100HZ), flv(16bits, 2channels, 44100HZ)
[2016-12-08 10:26:40.036][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:26:40.794][trace][13946][227] -> HLS time=5000, stream dts=348930(3877ms), sno=2, ts=http://m.cdn.wifiwx.com/live/wifiwx-85-1481164000037-1.ts, dur=0.69, dva=0p
[2016-12-08 10:26:43.377][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:26:46.539][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:26:49.744][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:26:50.634][trace][13946][227] -> HLS time=15000, stream dts=1245870(13843ms), sno=5, ts=http://m.cdn.wifiwx.com/live/wifiwx-85-1481164009745-4.ts, dur=0.99, dva=0p
[2016-12-08 10:26:53.199][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:26:56.185][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:26:56.427][trace][13946][227] <- CPB time=0, okbps=1,0,0, ikbps=2096,0,0, mr=0/350, p1stpt=20000, pnt=20000
[2016-12-08 10:26:59.386][warn][13946][227][11] hls: ts starts without IDR, first nalu=9, idr=0
[2016-12-08 10:27:00.623][trace][13946][227] -> HLS time=25000, stream dts=2147490(23861ms), sno=8, ts=http://m.cdn.wifiwx.com/live/wifiwx-85-1481164019388-7.ts, dur=1.32, dva=0p

wifiwx-85.1481163996416.flv.zip
@winlinvip winlinvip added this to the srs 2.0 release milestone Dec 8, 2016
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Dec 8, 2016

肯定是里面的264的NALU不标准，找时间看看是不是能兼容了。野鸡编码器一般都喜欢送奇奇怪怪的流。
@winlinvip winlinvip added the Bug label Jan 6, 2017
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 9, 2017

你这个文件ffmpeg说也是有问题的：

winlin:srs-plus winlin$ ffmpeg -i wifiwx-85.1481163996416.flv 
ffmpeg version 2.1.1 Copyright (c) 2000-2013 the FFmpeg developers
  built on Feb  5 2016 17:28:08 with Apple LLVM version 6.1.0 (clang-602.0.53) (based on LLVM 3.6.0svn)
  configuration: --enable-gpl --enable-nonfree --yasmexe=/Users/winlin/Desktop/git/srs-plus/trunk/objs/ffmpeg.src/_release/bin/yasm --prefix=/Users/winlin/Desktop/git/srs-plus/trunk/objs/ffmpeg.src/_release --cc= --enable-static --disable-shared --disable-debug --extra-cflags='-I${ffmpeg_exported_release_dir}/include' --extra-ldflags='-L${ffmpeg_exported_release_dir}/lib -lm -ldl' --disable-ffplay --disable-ffprobe --disable-ffserver --disable-doc --enable-postproc --enable-bzlib --enable-zlib --enable-parsers --enable-libx264 --enable-libmp3lame --enable-libfdk-aac --enable-libspeex --enable-pthreads --extra-libs=-lpthread --enable-encoders --enable-decoders --enable-avfilter --enable-muxers --enable-demuxers
  libavutil      52. 48.101 / 52. 48.101
  libavcodec     55. 39.101 / 55. 39.101
  libavformat    55. 19.104 / 55. 19.104
  libavdevice    55.  5.100 / 55.  5.100
  libavfilter     3. 90.100 /  3. 90.100
  libswscale      2.  5.101 /  2.  5.101
  libswresample   0. 17.104 /  0. 17.104
  libpostproc    52.  3.100 / 52.  3.100
[h264 @ 0x7fe5ee018000] top block unavailable for requested intra4x4 mode -1 at 2 0
[h264 @ 0x7fe5ee018000] error while decoding MB 2 0
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in I frame
[h264 @ 0x7fe5ee018000] Missing reference picture, default is 0
    Last message repeated 1 times
[h264 @ 0x7fe5ee018000] ref 32 overflow
[h264 @ 0x7fe5ee018000] error while decoding MB 13 0
[h264 @ 0x7fe5ee018000] Cannot use next picture in error concealment
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in P frame
[h264 @ 0x7fe5ee018000] Missing reference picture, default is 2
[h264 @ 0x7fe5ee018000] ref 14 overflow
[h264 @ 0x7fe5ee018000] error while decoding MB 13 0
[h264 @ 0x7fe5ee018000] Cannot use next picture in error concealment
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in P frame
[h264 @ 0x7fe5ee018000] ref 9 overflow
[h264 @ 0x7fe5ee018000] error while decoding MB 13 0
[h264 @ 0x7fe5ee018000] Cannot use next picture in error concealment
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in P frame
[h264 @ 0x7fe5ee018000] ref 14 overflow
[h264 @ 0x7fe5ee018000] error while decoding MB 13 0
[h264 @ 0x7fe5ee018000] Cannot use next picture in error concealment
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in P frame
[h264 @ 0x7fe5ee018000] ref 32 overflow
[h264 @ 0x7fe5ee018000] error while decoding MB 13 0
[h264 @ 0x7fe5ee018000] Cannot use next picture in error concealment
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in P frame
[h264 @ 0x7fe5ee018000] ref 7 overflow
[h264 @ 0x7fe5ee018000] error while decoding MB 13 0
[h264 @ 0x7fe5ee018000] Cannot use next picture in error concealment
[h264 @ 0x7fe5ee018000] concealing 2700 DC, 2700 AC, 2700 MV errors in P frame
Input #0, flv, from 'wifiwx-85.1481163996416.flv':
  Metadata:
    encoder         : Lavf56.15.102
    service         : SRS/2.0.221(ZhouGuowen)
  Duration: 00:00:37.68, start: 0.000000, bitrate: 2144 kb/s
    Stream #0:0: Video: h264 (Constrained Baseline), yuv420p, 960x720, 1000 kb/s, 30.30 tbr, 1k tbn, 60 tbc
    Stream #0:1: Audio: aac, 44100 Hz, mono, fltp, 128 kb/s
At least one output file must be specified
winlin:srs-plus winlin$
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 9, 2017 •
edited

srs rtmp dump录制的文件（没有修改数据的原始流）：https://github.com/ossrs/srs/files/638274/wifiwx-85.1481163996416.flv.zip

推送到SRS：

ffmpeg -re -i wifiwx-85.1481163996416.flv -c copy -f flv -y rtmp://127.0.0.1/live/livestream

服务器日志：

[2017-01-09 12:05:15.032][trace][67761][107] RTMP client ip=127.0.0.1, fd=10
[2017-01-09 12:05:15.032][trace][67761][107] srand initialized the random.
[2017-01-09 12:05:15.034][trace][67761][107] complex handshake success
[2017-01-09 12:05:15.034][trace][67761][107] connect app, tcUrl=rtmp://127.0.0.1:1935/live, pageUrl=, swfUrl=, schema=rtmp, vhost=__defaultVhost__, port=1935, app=live, args=null
[2017-01-09 12:05:15.034][trace][67761][107] client identified, type=fmle-publish, stream_name=livestream, duration=-1.00
[2017-01-09 12:05:15.060][trace][67761][107] source url=/live/livestream, ip=127.0.0.1, cache=1, is_edge=0, source_id=-1[-1]
[2017-01-09 12:05:15.061][trace][67761][107] hls: win=60.00, frag=10.00, prefix=, path=./objs/nginx/html, m3u8=[app]/[stream].m3u8, ts=[app]/[stream]-[seq].ts, aof=2.00, floor=0, clean=1, waitk=1, dispose=0
[2017-01-09 12:05:15.061][trace][67761][107] ignore disabled exec for vhost=__defaultVhost__
[2017-01-09 12:05:15.072][trace][67761][107] exec thread cid=110, current_cid=107
[2017-01-09 12:05:15.083][trace][67761][107] start publish mr=0/350, p1stpt=20000, pnt=20000, tcp_nodelay=0, rtcid=111
[2017-01-09 12:05:15.083][trace][67761][107] got metadata, width=960, height=720, vcodec=7, acodec=10
[2017-01-09 12:05:15.083][trace][67761][107] protocol in.buffer=0, in.ack=0, out.ack=2500000, in.chunk=60000, out.chunk=60000
[2017-01-09 12:05:15.083][trace][67761][107] 42B video sh,  codec(7, profile=Baseline, level=3.1, 960x720, 0kbps, 0fps, 0s)
[2017-01-09 12:05:15.083][trace][67761][107] 7B audio sh, codec(10, profile=LC, 1channels, 0kbps, 44100HZ), flv(16bits, 2channels, 44100HZ)
[2017-01-09 12:05:24.792][trace][67761][107] -> HLS time=10013, stream dts=874620(9718ms), sno=1, ts=livestream-0.ts, dur=9.72, dva=0p
[2017-01-09 12:05:25.279][warn][67761][107][35] hls: ts starts without IDR, first nalu=9, idr=0

大约是在切片的时间点出的日志：

bogon:live winlin$ cat livestream.m3u8 
#EXTM3U
#EXT-X-VERSION:3
#EXT-X-ALLOW-CACHE:YES
#EXT-X-MEDIA-SEQUENCE:0
#EXT-X-TARGETDURATION:15
#EXT-X-DISCONTINUITY
#EXTINF:10.192, no desc
livestream-0.ts
#EXTINF:10.196, no desc
livestream-1.ts

切出来的ts用VLC无法播放，都是绿屏和灰屏。RTMP是能播的。直接VLC播FLV文件也是能播的。
@easyhao007
Copy link

@easyhao007 easyhao007 commented Jan 9, 2017

总感觉这个flv文件中的264不是annexb，是mp4格式的h264封装，会不会出问题
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 9, 2017 •
edited

解析它的SPS/PPS，是第一帧视频发过来的，内容如下：

(lldb) p *msg
(SrsSharedPtrMessage) $7 = {
  timestamp = 0
  stream_id = 1
  size = 42
  payload = 0x00000001010034a0 "\x17"
  ptr = 0x0000000101003780
}
(lldb) x/42xb msg->payload
0x1010034a0: 0x17 0x00 0x00 0x00 0x00 0x01 0x42 0xc0
0x1010034a8: 0x1f 0xff 0xe1 0x00 0x16 0x67 0x42 0xc0
0x1010034b0: 0x1f 0xd9 0x00 0xf0 0x16 0xe8 0x40 0x00
0x1010034b8: 0x00 0x03 0x00 0x40 0x00 0x00 0x0f 0x03
0x1010034c0: 0xc6 0x0c 0x92 0x01 0x00 0x04 0x68 0xcb
0x1010034c8: 0x8e 0x20

封装都是对的，能进入到函数SrsAvcAacCodec::avc_demux_sps_pps里面解析SPS和PPS内容。SPS和PPS的字节如下：

(lldb) p avc_extra_size
(int) $25 = 37
(lldb) x/37xb avc_extra_data
0x1010037b0: 0x01 0x42 0xc0 0x1f 0xff 0xe1 0x00 0x16
0x1010037b8: 0x67 0x42 0xc0 0x1f 0xd9 0x00 0xf0 0x16
0x1010037c0: 0xe8 0x40 0x00 0x00 0x03 0x00 0x40 0x00
0x1010037c8: 0x00 0x0f 0x03 0xc6 0x0c 0x92 0x01 0x00
0x1010037d0: 0x04 0x68 0xcb 0x8e 0x20

SPS的数据如下：

(lldb) p sequenceParameterSetLength
(u_int16_t) $45 = 22
(lldb) x/22xb sequenceParameterSetNALUnit
0x101201550: 0x67 0x42 0xc0 0x1f 0xd9 0x00 0xf0 0x16
0x101201558: 0xe8 0x40 0x00 0x00 0x03 0x00 0x40 0x00
0x101201560: 0x00 0x0f 0x03 0xc6 0x0c 0x92

PPS数据如下：

(lldb) p pictureParameterSetLength
(u_int16_t) $52 = 4
(lldb) x/4xb pictureParameterSetNALUnit
0x101003310: 0x68 0xcb 0x8e 0x20

貌似SPS和PPS是没有啥特殊的地方。解析出来的SPS信息也是对的：

[2017-01-09 15:46:21.531][trace][83301][107] 42B video sh,  
codec(7, profile=Baseline, level=3.1, 960x720, 0kbps, 0fps, 0s)

对比FFMPEG的信息：

 Stream #0:0: Video: h264 (Constrained Baseline), yuv420p, 960x720, 
1000 kb/s, 30.30 tbr, 1k tbn, 60 tbc
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 9, 2017 •
edited

第一帧应该是个IDR帧，数据如下：

(lldb) x/128xb stream->p-4
0x102802e05: 0x00 0x00 0x00 0x02 0x09 0x30 0x00 0x00
0x102802e0d: 0x00 0x02 0x09 0x30 0x00 0x00 0x00 0x20
0x102802e15: 0x06 0x00 0x0d 0x80 0x80 0xd9 0x00 0x2e
0x102802e1d: 0xf1 0x80 0x80 0xd9 0x00 0x2e 0xf1 0xc0
0x102802e25: 0x01 0x09 0x00 0x20 0x08 0x24 0x68 0x00
0x102802e2d: 0x00 0x03 0x00 0x01 0x06 0x01 0xc4 0x80
0x102802e35: 0x00 0x00 0xee 0x52 0x21 0xb8 0x03 0x3f
0x102802e3d: 0xf9 0xd2 0x9c 0x11 0x2e 0x62 0x78 0x06
0x102802e45: 0xd2 0x65 0x0d 0x40 0xcd 0xda 0xad 0x49
0x102802e4d: 0x97 0x4d 0x4a 0x0b 0x5b 0x9c 0xab 0xea
0x102802e55: 0x8f 0x00 0x3d 0x95 0xbb 0x09 0x56 0x51
0x102802e5d: 0x30 0x47 0x9f 0x49 0x87 0x3f 0x99 0x9b
0x102802e65: 0x69 0x3c 0x8c 0x80 0x0b 0xd6 0x38 0x34
0x102802e6d: 0xed 0x08 0x81 0x66 0x38 0x99 0x0a 0x56
0x102802e75: 0x59 0x84 0xec 0xe3 0x06 0x29 0x44 0xd1
0x102802e7d: 0x9f 0x11 0x7f 0xbe 0xa7 0xe8 0x2f 0x5d

或者说，里面包含了几个NALU，每个都是size+data的ibmf格式：

(lldb) x/6xb stream->p-4
0x102802e05: 0x00 0x00 0x00 0x02 0x09 0x30

(lldb) x/6xb stream->p-4+6
0x102802e0b: 0x00 0x00 0x00 0x02 0x09 0x30

(lldb) x/36xb stream->p-4+6+6
0x102802e11: 0x00 0x00 0x00 0x20 0x06 0x00 0x0d 0x80
0x102802e19: 0x80 0xd9 0x00 0x2e 0xf1 0x80 0x80 0xd9
0x102802e21: 0x00 0x2e 0xf1 0xc0 0x01 0x09 0x00 0x20
0x102802e29: 0x08 0x24 0x68 0x00 0x00 0x03 0x00 0x01
0x102802e31: 0x06 0x01 0xc4 0x80

最后这个长度是0xee52也就是61010字节。
(lldb) x/128xb stream->p-4+6+6+36
0x102802e35: 0x00 0x00 0xee 0x52 0x21 0xb8 0x03 0x3f
0x102802e3d: 0xf9 0xd2 0x9c 0x11 0x2e 0x62 0x78 0x06
0x102802e45: 0xd2 0x65 0x0d 0x40 0xcd 0xda 0xad 0x49
0x102802e4d: 0x97 0x4d 0x4a 0x0b 0x5b 0x9c 0xab 0xea
0x102802e55: 0x8f 0x00 0x3d 0x95 0xbb 0x09 0x56 0x51
0x102802e5d: 0x30 0x47 0x9f 0x49 0x87 0x3f 0x99 0x9b
0x102802e65: 0x69 0x3c 0x8c 0x80 0x0b 0xd6 0x38 0x34
0x102802e6d: 0xed 0x08 0x81 0x66 0x38 0x99 0x0a 0x56
0x102802e75: 0x59 0x84 0xec 0xe3 0x06 0x29 0x44 0xd1
0x102802e7d: 0x9f 0x11 0x7f 0xbe 0xa7 0xe8 0x2f 0x5d
0x102802e85: 0x19 0x28 0x29 0x6c 0xe2 0xbd 0x05 0x6c
0x102802e8d: 0x9c 0x8e 0x9b 0xc7 0x1f 0x60 0x53 0x10
0x102802e95: 0x76 0x68 0x5d 0x1c 0xc0 0x1b 0x7e 0xc8
0x102802e9d: 0xa1 0x11 0x4d 0x23 0xc4 0xc5 0x48 0x6d
0x102802ea5: 0xd5 0xa1 0x08 0x69 0xc7 0x3d 0x25 0x31
0x102802ead: 0xad 0xe2 0x48 0x24 0xbe 0x74 0x6a 0x44

几个NALU加起来是6+6+36+61014=61062字节。这个video的payload有5字节的flv头，加上这个61062字节，就是61067字节：

(lldb) p size
(int) $38 = 61067
(lldb) x/16xb data
0x102802e00: 0x17 0x01 0x00 0x00 0x00 0x00 0x00 0x00
0x102802e08: 0x02 0x09 0x30 0x00 0x00 0x00 0x02 0x09

解析出来有4个NALU(sample)：

(lldb) p *sample
(SrsCodecSample) $63 = {
  nb_sample_units = 4
  sample_units = {
    [0] = (size = 2, bytes = "\t0")
    [1] = (size = 2, bytes = "\t0")
    [2] = (size = 32, bytes = "\x06")
    [3] = (size = 61010, bytes = "!\xffffffb8\x03?")

这几个NALU，分别是：

AUD，2字节(09 30)
AUD，2字节(09 30)
SEI，32字节(06 00 0d)
NonIDR，61010字节(21 b8 03)

而SRS如果没有IDR，就会不会插入SPS和PPS，导致花屏和报错。
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 9, 2017 •
edited

发送的视频帧数据。

SPS的数据如下：

(lldb) p sequenceParameterSetLength
(u_int16_t) $45 = 22
(lldb) x/22xb sequenceParameterSetNALUnit
0x101201550: 0x67 0x42 0xc0 0x1f 0xd9 0x00 0xf0 0x16
0x101201558: 0xe8 0x40 0x00 0x00 0x03 0x00 0x40 0x00
0x101201560: 0x00 0x0f 0x03 0xc6 0x0c 0x92

PPS数据如下：

(lldb) p pictureParameterSetLength
(u_int16_t) $52 = 4
(lldb) x/4xb pictureParameterSetNALUnit
0x101003310: 0x68 0xcb 0x8e 0x20

第一帧：

AUD，2字节(09 30)
AUD，2字节(09 30)
SEI，32字节(06 00 0d)
NonIDR，61010字节(21 b8 03)
frame_type = SrsCodecVideoAVCFrameKeyFrame
avc_packet_type = SrsCodecVideoAVCTypeNALU

(lldb) x/32xb SEI
0x102009415: 0x06 0x00 0x0d 0x80 0x80 0xd9 0x00 0x2e
0x10200941d: 0xf1 0x80 0x80 0xd9 0x00 0x2e 0xf1 0xc0
0x102009425: 0x01 0x09 0x00 0x20 0x08 0x24 0x68 0x00
0x10200942d: 0x00 0x03 0x00 0x01 0x06 0x01 0xc4 0x80

解析出RBSP数据，只有30字节（1字节的NALU头，一个03是标识位）：
(lldb) x/30xb rbsp
0x100703ec0: 0x00 0x0d 0x80 0x80 0xd9 0x00 0x2e 0xf1
0x100703ec8: 0x80 0x80 0xd9 0x00 0x2e 0xf1 0xc0 0x01
0x100703ed0: 0x09 0x00 0x20 0x08 0x24 0x68 0x00 0x00
0x100703ed8: 0x00 0x01 0x06 0x01 0xc4 0x80

第二帧：

AUD，2字节(09 10)
AUD，2字节(09 10)
SEI，32字节(06 01 09)
NonIDR，6640字节(21 e2 23)
frame_type = SrsCodecVideoAVCFrameInterFrame
avc_packet_type = SrsCodecVideoAVCTypeNALU

(lldb) x/14xb SEI
0x100814c15: 0x06 0x01 0x09 0x00 0x02 0x08 0x24 0x68
0x100814c1d: 0x00 0x00 0x03 0x00 0x01 0x80

第三帧：

AUD，2字节(09 30)
AUD，2字节(09 30)
SEI，32字节(06 01 09)
NonIDR，4600字节(21 e4 23)
frame_type = SrsCodecVideoAVCFrameInterFrame
avc_packet_type = SrsCodecVideoAVCTypeNALU

(lldb) x/14xb SEI
0x10201a015: 0x06 0x01 0x09 0x00 0x04 0x08 0x24 0x68
0x10201a01d: 0x00 0x00 0x03 0x00 0x01 0x80

第四帧：

AUD，2字节(09 30)
AUD，2字节(09 30)
SEI，32字节(06 01 09)
NonIDR，4685字节(21 e6 23)
frame_type = SrsCodecVideoAVCFrameInterFrame
avc_packet_type = SrsCodecVideoAVCTypeNALU

(lldb) x/14xb SEI
0x102802215: 0x06 0x01 0x09 0x00 0x06 0x08 0x24 0x68
0x10280221d: 0x00 0x00 0x03 0x00 0x01 0x80

目前可以确定就是大疆发的数据是NonIDR open gop的数据，一般都是IDR帧开头closed gop的。需要正确的处理这种类型的数据。
@winlinvip winlinvip modified the milestones: srs 3.0 release, srs 2.0 release Jan 10, 2017
@winlinvip winlinvip mentioned this issue Jan 10, 2017
Closed
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 10, 2017 •
edited

据说最新的FFMPEG可以正确处理这个流：

ffmpeg -re -i ~/Downloads/wifiwx-85.1481163996416.flv -c copy \
-flags global_header -f hls -hls_time 3 -hls_list_size 0 output.m3u8

注意：SRS的那个FFMPEG无法处理，也是报错的。

分析FFMPEG生成的TS，数据如下：

00 00 00 01 09 30 // AUD
00 00 01 09 30 // AUD
00 00 01 06 00 ...... // SEI
00 00 01 21 b8 03 ...... // I Frame

00 00 00 01 09 30 // AUD
00 00 01 09 30 // AUD
00 00 01 06 00 ...... // SEI
00 00 01 21 e6 23 ...... // I Frame

按照FFMPEG处理NonIDR的方式，就可以了（不是插入默认的AUD NALU，不写入SPS和PPS）。
@winlinvip winlinvip modified the milestones: srs 2.0 release, srs 3.0 release Jan 10, 2017
@winlinvip winlinvip closed this in c9a71b7 Jan 10, 2017
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 10, 2017 •
edited

总结来说：

  1. NonIDR，也就是open gop方式，FLV第一个包给出来的Sequence Header，上面的flv文件是Baseline，但是这个是错误的。在后续的Nalu中会给出正确的SPS和PPS，profile是High。
  2. IDR方式，也就是closed gop方式，使用FLV第一个包，也就是Sequence Header中的SPS和PPS。丢弃NALU中的SPS和PPS。

SRS doc下面Avatar的样片，NALU序列如下：

[2017-01-10 17:25:10.082][warn][51431][107][35] NALU SEI, size=688, 0x6 0x5 0xff
[2017-01-10 17:25:10.082][warn][51431][107][35] NALU IDR, size=4436, 0x65 0x88 0x84
[2017-01-10 17:25:10.082][warn][51431][107][35] NALU parsed, open_gop=0, keyframe=1

[2017-01-10 17:25:10.083][warn][51431][107][35] NALU NonIDR, size=123, 0x41 0x9a 0x21
[2017-01-10 17:25:10.083][warn][51431][107][35] NALU parsed, open_gop=0, keyframe=2
......
[2017-01-10 17:25:14.994][warn][51431][107][35] NALU NonIDR, size=32, 0x41 0x9a 0x1c
[2017-01-10 17:25:14.994][warn][51431][107][35] NALU parsed, open_gop=0, keyframe=2

[2017-01-10 17:25:15.029][warn][51431][107][35] NALU IDR, size=227, 0x65 0x88 0x82
[2017-01-10 17:25:15.029][warn][51431][107][35] NALU parsed, open_gop=0, keyframe=1

[2017-01-10 17:25:15.065][warn][51431][107][35] NALU NonIDR, size=21, 0x41 0x9a 0x21
[2017-01-10 17:25:15.065][warn][51431][107][35] NALU parsed, open_gop=0, keyframe=2

序列：
SEI IDR
NonIDR ......
IDR
NonIDR ......

大疆推的open-gop的序列如下：

[2017-01-10 17:27:14.137][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x30 0
[2017-01-10 17:27:14.137][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x30 0
[2017-01-10 17:27:14.137][warn][51623][107][35] NALU SEI, size=32, 0x6 0 0xd
[2017-01-10 17:27:14.137][warn][51623][107][35] NALU NonIDR, size=61010, 0x21 0xb8 0x3
[2017-01-10 17:27:14.137][warn][51623][107][35] NALU parsed, open_gop=1, keyframe=1

[2017-01-10 17:27:14.138][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x10 0
[2017-01-10 17:27:14.138][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x10 0
[2017-01-10 17:27:14.138][warn][51623][107][35] NALU SEI, size=14, 0x6 0x1 0x9
[2017-01-10 17:27:14.138][warn][51623][107][35] NALU NonIDR, size=6640, 0x21 0xe2 0x23
[2017-01-10 17:27:14.138][warn][51623][107][35] NALU parsed, open_gop=1, keyframe=2

......

[2017-01-10 17:27:14.560][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x30 0
[2017-01-10 17:27:14.560][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x30 0
[2017-01-10 17:27:14.560][warn][51623][107][35] NALU SPS, size=47, 0x27 0x64 0
[2017-01-10 17:27:14.560][warn][51623][107][35] NALU PPS, size=4, 0x28 0xee 0x38
[2017-01-10 17:27:14.560][warn][51623][107][35] NALU SEI, size=32, 0x6 0 0xd
[2017-01-10 17:27:14.560][warn][51623][107][35] NALU IDR, size=62883, 0x25 0xb8 0x20
[2017-01-10 17:27:14.560][warn][51623][107][35] NALU parsed, open_gop=1, keyframe=1

[2017-01-10 17:27:14.592][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x10 0
[2017-01-10 17:27:14.592][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x10 0
[2017-01-10 17:27:14.592][warn][51623][107][35] NALU SEI, size=14, 0x6 0x1 0x9
[2017-01-10 17:27:14.592][warn][51623][107][35] NALU NonIDR, size=6643, 0x21 0xe2 0x23
[2017-01-10 17:27:14.592][warn][51623][107][35] NALU parsed, open_gop=1, keyframe=2

......

[2017-01-10 17:27:16.772][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x30 0
[2017-01-10 17:27:16.772][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x30 0
[2017-01-10 17:27:16.772][warn][51623][107][35] NALU SPS, size=47, 0x27 0x64 0
[2017-01-10 17:27:16.772][warn][51623][107][35] NALU PPS, size=4, 0x28 0xee 0x38
[2017-01-10 17:27:16.772][warn][51623][107][35] NALU SEI, size=32, 0x6 0 0xd
[2017-01-10 17:27:16.772][warn][51623][107][35] NALU IDR, size=63008, 0x25 0xb8 0x20
[2017-01-10 17:27:16.772][warn][51623][107][35] NALU parsed, open_gop=1, keyframe=1

[2017-01-10 17:27:16.805][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x10 0
[2017-01-10 17:27:16.805][warn][51623][107][35] NALU AccessUnitDelimiter, size=2, 0x9 0x10 0
[2017-01-10 17:27:16.805][warn][51623][107][35] NALU SEI, size=14, 0x6 0x1 0x9
[2017-01-10 17:27:16.805][warn][51623][107][35] NALU NonIDR, size=6625, 0x21 0xe2 0x23
[2017-01-10 17:27:16.805][warn][51623][107][35] NALU parsed, open_gop=1, keyframe=2

......

序列：
AUD AUD SEI NonIDR ......
AUD AUD SEI SPS PPS IDR
AUD AUD SEI NonIDR ......
winlinvip added a commit that referenced this issue Jan 10, 2017
@winlinvip
for #635, support IDR and NonIDR(open-gop).
Loading status checks…
4104f25
winlinvip added a commit that referenced this issue Jan 10, 2017
@winlinvip
for #635, refine hls open/close gop.
Loading status checks…
6fbda2a
@winlinvip
Copy link
Member

@winlinvip winlinvip commented Jan 10, 2017 •
edited

最后把NonIDR和IDR统一起来了，SRS写HLS的策略是：

  1. 一个RTMP的VIDEO包，里面可能包含多个NALU。譬如Avatar那个片是SEI+IDR或NonIDR或IDR。大疆推的是AUD+AUD+SEI+NonIDR或AUD+AUD+SEI+SPS+PPS+IDR之类的。
  2. 如果NALU中没有AUD，就插入一个默认的AUD，总之以AUD开头。
  3. 如果NALU中没有SPS和PPS，并且有IDR，就在IDR之前插入SPS和PPS。
  4. 保持原始的NALU序列，譬如AUD和SEI还有SPS和PPS，都保留，不丢弃。
  5. 之前看Apple的例子，SPS和PPS总是以00 00 00 01开头，貌似没有必要，ffmpeg没有这样做。
@dodolzg dodolzg mentioned this issue Jan 18, 2018
Open
@durui-12315
Copy link

@durui-12315 durui-12315 commented Dec 16, 2020

用“DJI GO”（大彊无人机的APP）推流到SRS,RTMP播放正常，HLS无法播放，视频全是马赛克。同时测试推流到wowza服务器，wowoza上面生成的hls播放是正常的，请问这是什么原因？

我写的推流地址是rtmp://192.168.1.130:1935/live/livestream 但是显示一直在连接中,请问是什么原因呢?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Bug
Projects
None yet
Milestone
srs 2.0 release
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
@winlinvip @easyhao007 @xiaoyaowx @durui-12315