talksik/mediapipe
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,373 Commits 9 Branches 53 Tags
7db0c1944b856d842414e1a1dfdc106e83f2b982
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
MediaPipe TeamandCopybara-Service 7db0c1944b Internal change 
PiperOrigin-RevId: 551789915
 2023-07-28 02:29:52 -07:00
MediaPipe TeamandCopybara-Service db9a72a5df Internal Changes 
PiperOrigin-RevId: 551674542
 2023-07-27 16:35:35 -07:00
MediaPipe TeamandCopybara-Service 5c007558f8 internal change. 
PiperOrigin-RevId: 551645248
 2023-07-27 14:45:18 -07:00
MediaPipe TeamandCopybara-Service 5b31f1e3e9 Update glog to latest commit 
PiperOrigin-RevId: 551601991
 2023-07-27 12:07:20 -07:00
MediaPipe TeamandCopybara-Service f3f9e71ccb No public description 
PiperOrigin-RevId: 551549511
 2023-07-27 09:15:46 -07:00
MediaPipe TeamandCopybara-Service 6de275834d internal change. 
PiperOrigin-RevId: 551366789
 2023-07-26 17:59:06 -07:00
MediaPipe TeamandCopybara-Service fa5c1b03d2 No public description 
PiperOrigin-RevId: 551277242
 2023-07-26 12:08:33 -07:00
MediaPipe TeamandCopybara-Service 1f6851c577 C++ Image segmenter add output size parameters. 
PiperOrigin-RevId: 550995124
 2023-07-25 14:22:11 -07:00
MediaPipe TeamandCopybara-Service bd7888cc0c 1. Move evaluation onto GPU/TPU hardware if available. 
2. Move desired_precision and desired_recall from evaluate to hyperparameters so recall@precision metrics will be reported for both training and evaluation. This also fixes a bug where recompiling the model with the previously initialized metric objects would not properly reset the metric states.
3. Remove redundant label_names from create_... class methods in text_classifier. This information is already provided by the datasets.
4. Change loss function to FocalLoss.
5. Re-enable text_classifier unit tests using ExBert
6. Add input names to avoid flaky auto-assigned input names.

PiperOrigin-RevId: 550992146
 2023-07-25 14:12:26 -07:00
MediaPipe TeamandCopybara-Service 85c3fed70a Add class weights to core hyperparameters and classifier library. 
PiperOrigin-RevId: 550962843
 2023-07-25 12:29:46 -07:00
MediaPipe TeamandCopybara-Service 62538a9496 No public description 
PiperOrigin-RevId: 550954023
 2023-07-25 11:57:08 -07:00
MediaPipe TeamandCopybara-Service 113c9b30c2 No public description 
PiperOrigin-RevId: 550616150
 2023-07-24 11:09:31 -07:00
MediaPipe TeamandCopybara-Service 25b01784de Fix documentation 
PiperOrigin-RevId: 549968822
 2023-07-21 09:33:48 -07:00
MediaPipe TeamandCopybara-Service 9af637b125 Java API add visibility and presence for landmarks. 
PiperOrigin-RevId: 549709256
 2023-07-20 12:42:01 -07:00
MediaPipe TeamandCopybara-Service 085840388b Move waitOnCpu and waitOnGpu out of the synchronized block, which can cause deadlock. 
PiperOrigin-RevId: 549217916
 2023-07-18 23:42:01 -07:00
MediaPipe TeamandCopybara-Service 4e72fcf0cb Replace CHECK with RET_CHECK in GetContract() implementation from six calculators. 
PiperOrigin-RevId: 549158984
 2023-07-18 17:38:44 -07:00
MediaPipe TeamandCopybara-Service 4c60fe7365 add pose landmarks connections in C++ API 
PiperOrigin-RevId: 549108310
 2023-07-18 14:21:02 -07:00
MediaPipe TeamandCopybara-Service 9b00582f21 add hand landmarks connections in C++ API. 
PiperOrigin-RevId: 549108307
 2023-07-18 14:16:27 -07:00
MediaPipe TeamandCopybara-Service cb915858fa Internal change 
PiperOrigin-RevId: 549052451
 2023-07-18 11:01:37 -07:00
MediaPipe TeamandCopybara-Service ef12ce8575 Internal change 
PiperOrigin-RevId: 548821518
 2023-07-17 15:56:05 -07:00
MediaPipe TeamandCopybara-Service f1f9f80cd9 Internal change 
PiperOrigin-RevId: 548746432
 2023-07-17 11:18:00 -07:00
MediaPipe TeamandCopybara-Service 17bc1a5ab5 Internal change 
PiperOrigin-RevId: 548196034
 2023-07-14 12:39:45 -07:00
MediaPipe TeamandCopybara-Service 2fae07375c Discard outdated packets earlier in MuxInputStreamHandler. 
In our pipeline, a deadlock is detected because the packets in deselected
data streams get piled up. In the current implementation, those packets only get
removed in FillInputSet(), but we should also do that in GetNodeReadiness().

PiperOrigin-RevId: 548051369
 2023-07-14 01:12:14 -07:00
MediaPipe TeamandCopybara-Service 723e91cec1 Generalize non-define registration with MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE 
PiperOrigin-RevId: 547929982
 2023-07-13 14:52:37 -07:00
MediaPipe TeamandCopybara-Service c2c67c20fa Internal change 
PiperOrigin-RevId: 547924907
 2023-07-13 14:37:40 -07:00
MediaPipe TeamandCopybara-Service 8b59567cb7 Add proto3 Any proto support for Java task api 
PiperOrigin-RevId: 547836041
 2023-07-13 10:10:17 -07:00
MediaPipe TeamandCopybara-Service e37bedd344 Fix Halide BUILD rules 
PiperOrigin-RevId: 547755467
 2023-07-13 04:47:34 -07:00
MediaPipe TeamandCopybara-Service 251c5421f6 Internal change 
PiperOrigin-RevId: 547735699
 2023-07-13 02:53:16 -07:00
MediaPipe TeamandCopybara-Service 450c933cb5 MEDIAPIPE_NODE/SUBGRAPH_IMPLEMENTATION to use common define for registration 
PiperOrigin-RevId: 547669538
 2023-07-12 20:10:15 -07:00
MediaPipe TeamandCopybara-Service cc2aa4f4cc InferenceCalculatorAdvancedGL save cache in Open(). 
PiperOrigin-RevId: 547652481
 2023-07-12 18:09:51 -07:00
MediaPipe TeamandCopybara-Service a2cd3e7f95 Internal change 
PiperOrigin-RevId: 547614484
 2023-07-12 15:17:40 -07:00
MediaPipe TeamandCopybara-Service 37b68714b8 Internal change 
PiperOrigin-RevId: 547424721
 2023-07-12 01:32:51 -07:00
MediaPipe TeamandCopybara-Service 3e93cbc838 Internal change 
PiperOrigin-RevId: 547404737
 2023-07-12 00:04:40 -07:00
MediaPipe TeamandCopybara-Service aabf61f28d Internal Change 
PiperOrigin-RevId: 547299595
 2023-07-11 14:35:18 -07:00
MediaPipe TeamandCopybara-Service 56bc019819 Model Maker allow core dataset library to handle datasets with unknown sizes. 
PiperOrigin-RevId: 547268411
 2023-07-11 12:47:37 -07:00
MediaPipe TeamandCopybara-Service 4788fddde9 Internal Change 
PiperOrigin-RevId: 547265380
 2023-07-11 12:34:32 -07:00
MediaPipe TeamandCopybara-Service e4ec4d2526 Internal change 
PiperOrigin-RevId: 547258228
 2023-07-11 12:05:58 -07:00
MediaPipe TeamandCopybara-Service bf6561ce91 add symmetric color style option 
PiperOrigin-RevId: 547069284
 2023-07-10 21:41:01 -07:00
MediaPipe TeamandCopybara-Service 0bde987a38 Removed internal dependency on OpenCV 3.x, migrating it to OpenCV 4.x 
PiperOrigin-RevId: 546945166
 2023-07-10 12:17:54 -07:00
MediaPipe TeamandCopybara-Service d45b15ef84 Add face landmarks connections for C++. 
PiperOrigin-RevId: 546345842
 2023-07-07 12:08:09 -07:00
MediaPipe TeamandCopybara-Service cb1035a9ee Internal change 
PiperOrigin-RevId: 546090489
 2023-07-06 14:24:31 -07:00
MediaPipe TeamandCopybara-Service 15ee1210e5 Internal change 
PiperOrigin-RevId: 546035969
 2023-07-06 10:58:20 -07:00
MediaPipe TeamandCopybara-Service 74f484d96d Internal change 
PiperOrigin-RevId: 545658434
 2023-07-05 07:09:40 -07:00
MediaPipe TeamandCopybara-Service dbe8e40124 Internal change 
PiperOrigin-RevId: 545045282
 2023-07-03 10:04:19 -07:00
MediaPipe TeamandCopybara-Service 7ba21e9a9a Revert Add location info in registry (debug mode only) 
PiperOrigin-RevId: 544842663
 2023-07-01 01:11:02 -07:00
MediaPipe TeamandCopybara-Service 422556c4a3 Internal change 
PiperOrigin-RevId: 544663494
 2023-06-30 08:34:32 -07:00
MediaPipe TeamandCopybara-Service 687075e5b8 Add gpu to cpu fallback for tensors_to_detections_calculator. 
PiperOrigin-RevId: 544480883
 2023-06-29 15:36:33 -07:00
MediaPipe TeamandCopybara-Service 0ea54b1461 Add delegate options to base options for java API. and add unit tset for BaseOptions. 
PiperOrigin-RevId: 544458644
 2023-06-29 14:13:46 -07:00
MediaPipe TeamandCopybara-Service e15d5a797b Do not send PreviousLoopback output packets to closed streams 
PiperOrigin-RevId: 544449979
 2023-06-29 13:44:56 -07:00
MediaPipe TeamandCopybara-Service 52cea59d41 Add keys for the context that better match the featurelist for text. 
PiperOrigin-RevId: 544430289
 2023-06-29 12:29:49 -07:00
MediaPipe TeamandCopybara-Service 0bb4ee8941 Add MobileNetV2_I320 and MobileNetMultiHWAVG_I384 to support larger input image sizes. 
PiperOrigin-RevId: 544393692
 2023-06-29 10:24:52 -07:00
MediaPipe TeamandCopybara-Service 8278dbc38f Exposes OpenCV photo lib. 
PiperOrigin-RevId: 544092832
 2023-06-28 10:22:07 -07:00
MediaPipe TeamandCopybara-Service 1ee55d1f1b Support ExBert training and option to select between AdamW and LAMB optimizers for BertClassifier 
PiperOrigin-RevId: 543905014
 2023-06-27 18:05:15 -07:00
MediaPipe TeamandCopybara-Service bed624f3b6 Shows the recently added warning when WaitUntilIdle is called with source nodes only once. Otherwise, it is very spammy as it's shown every frame. Moreover, display the names of the sources, so the warning is more actionable. 
PiperOrigin-RevId: 543676454
 2023-06-27 02:03:04 -07:00
MediaPipe TeamandCopybara-Service c8c5f3d062 Internal change 
PiperOrigin-RevId: 543602625
 2023-06-26 18:57:21 -07:00
MediaPipe TeamandCopybara-Service 9de1b2577f Internal update 
PiperOrigin-RevId: 543508346
 2023-06-26 12:26:51 -07:00
MediaPipe TeamandCopybara-Service 570880190b Internal change for proto library outputs. 
PiperOrigin-RevId: 543368974
 2023-06-26 01:52:50 -07:00
MediaPipe TeamandCopybara-Service a8899da45a Fix -Wsign-compare warning in api2/builder.h 
PiperOrigin-RevId: 542673286
 2023-06-22 14:49:23 -07:00
MediaPipe TeamandCopybara-Service 4e862995ba Fix typo 
PiperOrigin-RevId: 542660548
 2023-06-22 14:02:16 -07:00
MediaPipe TeamandCopybara-Service 2f5fc16a38 Fix timestamp computation when copying within first block. 
When computing the last copied sample's timestamp, first_block_offset_ needs to be taken into account.

PiperOrigin-RevId: 542643291
 2023-06-22 13:03:36 -07:00
MediaPipe TeamandCopybara-Service ba7e0e0e50 Add a face alignment preprocessor to face stylizer. 
PiperOrigin-RevId: 542559764
 2023-06-22 07:59:52 -07:00
MediaPipe TeamandCopybara-Service 825e3a8af0 Speed up TimeSeriesFramerCalculator. 
Currently, TimeSeriesFramerCalculator constructs a distinct Matrix object for every input sample, which is inefficient. This CL revises buffering to keep each input packet's worth of samples as one grouped Matrix. A benchmark is added, showing a speed up of about 20x.

```
name                               old      new
BM_TimeSeriesFramerCalculator  48.45ms   2.26ms
```

PiperOrigin-RevId: 542462618
 2023-06-21 23:03:54 -07:00
MediaPipe TeamandCopybara-Service 0d2548cd65 Internal change 
PiperOrigin-RevId: 542392817
 2023-06-21 16:23:43 -07:00
MediaPipe TeamandCopybara-Service c86d80a031 Internal Changes 
PiperOrigin-RevId: 542387813
 2023-06-21 16:02:54 -07:00
MediaPipe TeamandCopybara-Service 895c685df6 1. Model maker core classifier change _metric_function field to _metric_functions in order to support having multiple metrics. 
2. Add SparsePrecision, SparseRecall, BinarySparsePrecisionAtRecall, and BinarySparseRecallAtPrecision to the shared metrics library.
3. Add SparsePrecision, SparseRecall to text classifier, and have the option to evaluate the model with BinarySparsePrecisionAtRecall and BinarySparseRecallAtPrecision

PiperOrigin-RevId: 542376451
 2023-06-21 15:19:29 -07:00
MediaPipe TeamandCopybara-Service 7edb6b8fcb add concatenate image vector calculator 
PiperOrigin-RevId: 542084345
 2023-06-20 16:40:11 -07:00
MediaPipe TeamandCopybara-Service 0b6ff84e3c update face drawing function. 
PiperOrigin-RevId: 542083042
 2023-06-20 16:34:27 -07:00
MediaPipe TeamandCopybara-Service 86bc764b6e This will fix typos in tasks internal files. 
PiperOrigin-RevId: 541945726
 2023-06-20 09:18:01 -07:00
MediaPipe TeamandCopybara-Service 35c79b755e update face drawing function. 
PiperOrigin-RevId: 541055040
 2023-06-16 17:46:11 -07:00
MediaPipe TeamandCopybara-Service 80208079d2 Use GFile for internal file systems. 
PiperOrigin-RevId: 541041972
 2023-06-16 16:45:56 -07:00
MediaPipe TeamandCopybara-Service 6f065bc405 Update Tensorflow dependency in MediaPipe 
PiperOrigin-RevId: 540619536
 2023-06-15 10:23:20 -07:00
MediaPipe TeamandCopybara-Service 2e48a0bce0 Remove designated initializers 
PiperOrigin-RevId: 540471772
 2023-06-14 22:17:20 -07:00
MediaPipe TeamandCopybara-Service e02d70f8e5 internal change 
PiperOrigin-RevId: 540404812
 2023-06-14 16:00:00 -07:00
MediaPipe TeamandCopybara-Service 4776ecf402 Internal change 
PiperOrigin-RevId: 540361672
 2023-06-14 13:23:36 -07:00
MediaPipe TeamandCopybara-Service a1be5f3e72 Add a test case for "summary packet" to test failing upstream calculator 
PiperOrigin-RevId: 540331486
 2023-06-14 11:34:17 -07:00
MediaPipe TeamandCopybara-Service 66a29bf371 Internal change 
PiperOrigin-RevId: 540327302
 2023-06-14 11:23:51 -07:00
MediaPipe TeamandCopybara-Service 3742bc8c1b Add metadata for all PREFIX/image... prefixes. 
PiperOrigin-RevId: 540117214
 2023-06-13 17:12:17 -07:00
MediaPipe TeamandCopybara-Service 02d55dfb0a Modify the TensorToImageFrameCalculator to support normalized outputs. 
PiperOrigin-RevId: 540104988
 2023-06-13 16:20:42 -07:00
MediaPipe TeamandCopybara-Service b97d11fa76 Internal MediaPipe Tasks change 
PiperOrigin-RevId: 540083633
 2023-06-13 15:05:04 -07:00
MediaPipe TeamandCopybara-Service e468bee584 Deprecate GraphStatus() 
PiperOrigin-RevId: 539992850
 2023-06-13 09:54:22 -07:00
MediaPipe TeamandCopybara-Service b19b80e10f Add support for int64 constant side package value. 
PiperOrigin-RevId: 539893314
 2023-06-13 01:53:13 -07:00
MediaPipe TeamandCopybara-Service 96cc0fd07b Internal change 
PiperOrigin-RevId: 539719443
 2023-06-12 11:53:48 -07:00
MediaPipe TeamandCopybara-Service fe0d1b1e83 Internal change 
PiperOrigin-RevId: 539675912
 2023-06-12 09:28:26 -07:00
MediaPipe TeamandCopybara-Service ac4f60a793 Annotate in model input scale for InteractiveSegmenter 
PiperOrigin-RevId: 539245617
 2023-06-09 21:13:20 -07:00
MediaPipe TeamandCopybara-Service 1d4a205c2e Internal change 
PiperOrigin-RevId: 539220863
 2023-06-09 18:06:50 -07:00
MediaPipe TeamandCopybara-Service 53f0736bf0 Add an option to disable explicit CPU sync for ExternalTextureRenderer 
PiperOrigin-RevId: 539166965
 2023-06-09 13:42:14 -07:00
MediaPipe TeamandCopybara-Service 943445fba8 Update base audio/vision tasks api to suuport proto3 graph options. 
PiperOrigin-RevId: 538661975
 2023-06-07 20:04:33 -07:00
MediaPipe TeamandCopybara-Service 4b0f3cacae Internal change 
PiperOrigin-RevId: 538313290
 2023-06-06 15:52:55 -07:00
MediaPipe TeamandCopybara-Service 37290f0224 Port StreamToSidePacketCalculator to api2 
PiperOrigin-RevId: 538109898
 2023-06-06 01:34:43 -07:00
MediaPipe TeamandCopybara-Service ab72fccca7 Internal change 
PiperOrigin-RevId: 537928827
 2023-06-05 11:14:28 -07:00
MediaPipe TeamandCopybara-Service cbf1d97429 Internal change 
PiperOrigin-RevId: 537613648
 2023-06-03 20:19:16 -07:00
MediaPipe TeamandCopybara-Service b69f93fca6 Internal change 
PiperOrigin-RevId: 537381138
 2023-06-02 12:31:55 -07:00
MediaPipe TeamandCopybara-Service 280bd320b4 Fix more OSS warnings and build errors 
-Wc++98-compat-extra-semi
* in type_map.h

-Winconsistent-missing-override
* in gl_texture_buffer.h

-Wdeprecated-declarations
* usage of (absl) Status in
  * status_util.cc
  * api2/packet.h
  * output_stream_shard.cc

-Wimplicit-const-int-float-conversion
* Adds a static_cast to handle the precision loss when converting from large ints to floating point

ANNOTATE_THREAD_NAME
* explicitly uses ABSL_ANNOTATE_THREAD_NAME instead. This is useful in Chromium's build where there are multiple ANNOTATE_THREAD_NAME symbols

Also ran clang-format over all of each edited file

PiperOrigin-RevId: 537351290
 2023-06-02 10:46:42 -07:00
MediaPipe TeamandCopybara-Service 9045a74ba3 Internal change 
PiperOrigin-RevId: 537175065
 2023-06-01 17:48:03 -07:00
MediaPipe TeamandCopybara-Service 15aff443b1 Internal change 
PiperOrigin-RevId: 537089863
 2023-06-01 12:00:44 -07:00
MediaPipe TeamandCopybara-Service 01cfb92e35 Add MultiLandmarksSmoothingCalculator 
PiperOrigin-RevId: 536490704
 2023-05-30 13:20:55 -07:00
MediaPipe TeamandCopybara-Service c73027926f Add MultiLandmarksSmoothingCalculator 
PiperOrigin-RevId: 536478601
 2023-05-30 12:37:05 -07:00
MediaPipe TeamandCopybara-Service a432559123 Port LandmarksSmoothingCalculator to api2 
PiperOrigin-RevId: 536474279
 2023-05-30 12:20:23 -07:00
MediaPipe TeamandCopybara-Service 056881f4a9 Only apply face landmarks smoothing for stream mode (VIDEO and LIVE_STREAM). 
PiperOrigin-RevId: 536455842
 2023-05-30 11:16:43 -07:00
MediaPipe TeamandCopybara-Service 759e9fd56e Reorganize the face stylizer test data. 
PiperOrigin-RevId: 536074239
 2023-05-28 19:28:14 -07:00