Commit Graph
100 Commits
Author SHA1 Message Date
MediaPipe TeamandCopybara-Service ee217ceb67 Fix MediaPipe build in Chromium.
When building Chromium with Clang on Windows, it needs the template specializations to be declared as well.

PiperOrigin-RevId: 557508703
2023-08-16 09:23:15 -07:00
MediaPipe TeamandCopybara-Service ff17846c6a No public description
PiperOrigin-RevId: 557490568
2023-08-16 08:16:30 -07:00
MediaPipe TeamandCopybara-Service ff3f0433d3 Fix image_util shortcut import line
PiperOrigin-RevId: 557311617
2023-08-15 18:19:13 -07:00
MediaPipe TeamandCopybara-Service 1c98270ef0 Import image_util for using it in mediapipe face stylizer open sourcing.
PiperOrigin-RevId: 557254489
2023-08-15 14:41:57 -07:00
MediaPipe TeamandCopybara-Service cda0ba04ed Dry-Run mode for static registration to make it easier to find all required static registrations
PiperOrigin-RevId: 557185347
2023-08-15 11:03:18 -07:00
MediaPipe TeamandCopybara-Service c1d7e6023a Expose tool calculators in headers to enable dynamic registration by superusers.
PiperOrigin-RevId: 557174440
2023-08-15 10:32:45 -07:00
MediaPipe TeamandCopybara-Service a392561b31 Internal change
PiperOrigin-RevId: 557015628
2023-08-14 22:16:20 -07:00
MediaPipe TeamandCopybara-Service 0da296536b Expose stream handlers in headers to allow dynamic registration for superusers
PiperOrigin-RevId: 556988288
2023-08-14 20:01:50 -07:00
MediaPipe TeamandCopybara-Service b6f5414b3d Support more GPU formats in tensor converter calculator.
PiperOrigin-RevId: 556987807
2023-08-14 19:57:05 -07:00
MediaPipe TeamandCopybara-Service a183212a13 Header for callback_packet_calculator to allow dynamic registration for superusers
PiperOrigin-RevId: 556977122
2023-08-14 18:50:11 -07:00
MediaPipe TeamandCopybara-Service 9c5bdd2eb9 Clarify deprecated GraphStatus usage in Close documentation
PiperOrigin-RevId: 556963967
2023-08-14 17:53:32 -07:00
MediaPipe TeamandCopybara-Service dd940707ca Provide a way to disable static registration using MEDIAPIPE_DISABLE_STATIC_REGISTRATION
PiperOrigin-RevId: 556963956
2023-08-14 17:48:25 -07:00
MediaPipe TeamandCopybara-Service 6605fdb16f add end loop calculator for image size
PiperOrigin-RevId: 556955370
2023-08-14 17:09:02 -07:00
MediaPipe TeamandCopybara-Service a8bee6baf3 Updates the runners to support wasm-style binary assets files, and allows their URLs to be explicitly specified as part of the WasmFileset.
PiperOrigin-RevId: 556903356
2023-08-14 13:59:53 -07:00
MediaPipe TeamandCopybara-Service c8ad606e7c Refactor text_classifier preprocessor to move away from using classifier_data_lib
PiperOrigin-RevId: 556859900
2023-08-14 11:41:09 -07:00
MediaPipe TeamandCopybara-Service 3ac3b03ed5 Migrate packet messages auto registration to rely on MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE
PiperOrigin-RevId: 556063007
2023-08-11 13:14:29 -07:00
MediaPipe TeamandCopybara-Service 91f15d8e4a Enable run inference with a TFLite model containing multiple subgraphs. It uses the subgraph 0 as the default primary subgraph for inference. It will also log a warning in the case that there are more than one subgraph in the model.
PiperOrigin-RevId: 555579131
2023-08-10 11:30:32 -07:00
MediaPipe TeamandCopybara-Service a9c7e22ca4 apply affine transform before drawing, in order to keep constant line width regardless of face cropping.
PiperOrigin-RevId: 555173659
2023-08-09 08:42:57 -07:00
MediaPipe TeamandCopybara-Service 00e0314040 Remove unsafe cast.
PiperOrigin-RevId: 555007705
2023-08-08 18:50:11 -07:00
MediaPipe TeamandCopybara-Service f9a0244c5b No public description
PiperOrigin-RevId: 555005770
2023-08-08 18:38:34 -07:00
MediaPipe TeamandCopybara-Service e558a71597 Include calculator_context.h and calculator_contract.h from calculator_framework.h
PiperOrigin-RevId: 554931086
2023-08-08 13:54:59 -07:00
MediaPipe TeamandCopybara-Service 39b31e51a9 No public description
PiperOrigin-RevId: 554673463
2023-08-07 20:15:34 -07:00
MediaPipe TeamandCopybara-Service 032ed973b6 Add setGpuBufferVerticalFlip to GraphRunner TS API
PiperOrigin-RevId: 554667869
2023-08-07 19:44:21 -07:00
MediaPipe TeamandCopybara-Service c1c51c2fe7 Internal
PiperOrigin-RevId: 554595324
2023-08-07 14:36:42 -07:00
MediaPipe TeamandCopybara-Service e10bcd1bfd No public description
PiperOrigin-RevId: 554084475
2023-08-05 08:36:24 -07:00
MediaPipe TeamandCopybara-Service 11508f2291 Internal Change
PiperOrigin-RevId: 553652444
2023-08-03 18:49:35 -07:00
MediaPipe TeamandCopybara-Service 360959e325 Replace some size EXPECTs by ASSERTs
PiperOrigin-RevId: 553555650
2023-08-03 12:27:52 -07:00
MediaPipe TeamandCopybara-Service a0b91e4062 Add a GpuOrigin parameter to TensorConverterCalculator
The parameter superseeds flip_vertically. GpuOrigin works more generally than flip_vertically because CONVENTIONAL works on both iOS (no flip) and Android (yes flip). If not set, the calculator falls back to flip_vertically for backwards compatibility.

Note that web demos actually use TOP_LEFT image orientation, so they shouldn't be flipped, but they still are by CONVENTIONAL. That's being discussed right now.

PiperOrigin-RevId: 553400525
2023-08-03 01:40:13 -07:00
MediaPipe TeamandCopybara-Service 9325af0af3 vlog default executor and its config usage
PiperOrigin-RevId: 553298440
2023-08-02 17:01:05 -07:00
MediaPipe TeamandCopybara-Service e56636b6d1 internal change
PiperOrigin-RevId: 553250547
2023-08-02 14:06:16 -07:00
MediaPipe TeamandCopybara-Service 366a3290cf Change to add the w_avg latent code to style encoding before layer swapping. This is a bug in the previous code. Also set training=True for encoder since this affect the encoding performance.
PiperOrigin-RevId: 553234376
2023-08-02 13:11:22 -07:00
MediaPipe TeamandCopybara-Service 6e54d8c204 Log stack traces for combined CalculatorGraph statuses
PiperOrigin-RevId: 553111356
2023-08-02 05:10:52 -07:00
MediaPipe TeamandCopybara-Service 557ed0b1ea Add tensorflow-addons to model_maker requirements.txt
PiperOrigin-RevId: 552610011
2023-07-31 15:36:25 -07:00
MediaPipe TeamandCopybara-Service 6f916a001c Fix crash in SavePngTestOutput
Do not call SavePngTestOutput in CompareAndSaveImageOutput in case diff_img is null. This can happen if for instance the expected and the actual image have non-matching format or size. Currently, this crashes.
Support single channel golden images.

PiperOrigin-RevId: 552519834
2023-07-31 10:20:06 -07:00
MediaPipe TeamandCopybara-Service 8e313b4b0c Fix typo in model maker requirements.txt
PiperOrigin-RevId: 551973577
2023-07-28 16:07:12 -07:00
MediaPipe TeamandCopybara-Service 3f7752561b No public description
PiperOrigin-RevId: 551914786
2023-07-28 12:05:38 -07:00
MediaPipe TeamandCopybara-Service 9edb059d9f No public description
PiperOrigin-RevId: 551868738
2023-07-28 09:09:39 -07:00
MediaPipe TeamandCopybara-Service 7db0c1944b Internal change
PiperOrigin-RevId: 551789915
2023-07-28 02:29:52 -07:00
MediaPipe TeamandCopybara-Service db9a72a5df Internal Changes
PiperOrigin-RevId: 551674542
2023-07-27 16:35:35 -07:00
MediaPipe TeamandCopybara-Service 5c007558f8 internal change.
PiperOrigin-RevId: 551645248
2023-07-27 14:45:18 -07:00
MediaPipe TeamandCopybara-Service 5b31f1e3e9 Update glog to latest commit
PiperOrigin-RevId: 551601991
2023-07-27 12:07:20 -07:00
MediaPipe TeamandCopybara-Service f3f9e71ccb No public description
PiperOrigin-RevId: 551549511
2023-07-27 09:15:46 -07:00
MediaPipe TeamandCopybara-Service 6de275834d internal change.
PiperOrigin-RevId: 551366789
2023-07-26 17:59:06 -07:00
MediaPipe TeamandCopybara-Service fa5c1b03d2 No public description
PiperOrigin-RevId: 551277242
2023-07-26 12:08:33 -07:00
MediaPipe TeamandCopybara-Service 1f6851c577 C++ Image segmenter add output size parameters.
PiperOrigin-RevId: 550995124
2023-07-25 14:22:11 -07:00
MediaPipe TeamandCopybara-Service bd7888cc0c 1. Move evaluation onto GPU/TPU hardware if available.
2. Move desired_precision and desired_recall from evaluate to hyperparameters so recall@precision metrics will be reported for both training and evaluation. This also fixes a bug where recompiling the model with the previously initialized metric objects would not properly reset the metric states.
3. Remove redundant label_names from create_... class methods in text_classifier. This information is already provided by the datasets.
4. Change loss function to FocalLoss.
5. Re-enable text_classifier unit tests using ExBert
6. Add input names to avoid flaky auto-assigned input names.

PiperOrigin-RevId: 550992146
2023-07-25 14:12:26 -07:00
MediaPipe TeamandCopybara-Service 85c3fed70a Add class weights to core hyperparameters and classifier library.
PiperOrigin-RevId: 550962843
2023-07-25 12:29:46 -07:00
MediaPipe TeamandCopybara-Service 62538a9496 No public description
PiperOrigin-RevId: 550954023
2023-07-25 11:57:08 -07:00
MediaPipe TeamandCopybara-Service 113c9b30c2 No public description
PiperOrigin-RevId: 550616150
2023-07-24 11:09:31 -07:00
MediaPipe TeamandCopybara-Service 25b01784de Fix documentation
PiperOrigin-RevId: 549968822
2023-07-21 09:33:48 -07:00
MediaPipe TeamandCopybara-Service 9af637b125 Java API add visibility and presence for landmarks.
PiperOrigin-RevId: 549709256
2023-07-20 12:42:01 -07:00
MediaPipe TeamandCopybara-Service 085840388b Move waitOnCpu and waitOnGpu out of the synchronized block, which can cause deadlock.
PiperOrigin-RevId: 549217916
2023-07-18 23:42:01 -07:00
MediaPipe TeamandCopybara-Service 4e72fcf0cb Replace CHECK with RET_CHECK in GetContract() implementation from six calculators.
PiperOrigin-RevId: 549158984
2023-07-18 17:38:44 -07:00
MediaPipe TeamandCopybara-Service 4c60fe7365 add pose landmarks connections in C++ API
PiperOrigin-RevId: 549108310
2023-07-18 14:21:02 -07:00
MediaPipe TeamandCopybara-Service 9b00582f21 add hand landmarks connections in C++ API.
PiperOrigin-RevId: 549108307
2023-07-18 14:16:27 -07:00
MediaPipe TeamandCopybara-Service cb915858fa Internal change
PiperOrigin-RevId: 549052451
2023-07-18 11:01:37 -07:00
MediaPipe TeamandCopybara-Service ef12ce8575 Internal change
PiperOrigin-RevId: 548821518
2023-07-17 15:56:05 -07:00
MediaPipe TeamandCopybara-Service f1f9f80cd9 Internal change
PiperOrigin-RevId: 548746432
2023-07-17 11:18:00 -07:00
MediaPipe TeamandCopybara-Service 17bc1a5ab5 Internal change
PiperOrigin-RevId: 548196034
2023-07-14 12:39:45 -07:00
MediaPipe TeamandCopybara-Service 2fae07375c Discard outdated packets earlier in MuxInputStreamHandler.
In our pipeline, a deadlock is detected because the packets in deselected
data streams get piled up. In the current implementation, those packets only get
removed in FillInputSet(), but we should also do that in GetNodeReadiness().

PiperOrigin-RevId: 548051369
2023-07-14 01:12:14 -07:00
MediaPipe TeamandCopybara-Service 723e91cec1 Generalize non-define registration with MEDIAPIPE_STATIC_REGISTRATOR_TEMPLATE
PiperOrigin-RevId: 547929982
2023-07-13 14:52:37 -07:00
MediaPipe TeamandCopybara-Service c2c67c20fa Internal change
PiperOrigin-RevId: 547924907
2023-07-13 14:37:40 -07:00
MediaPipe TeamandCopybara-Service 8b59567cb7 Add proto3 Any proto support for Java task api
PiperOrigin-RevId: 547836041
2023-07-13 10:10:17 -07:00
MediaPipe TeamandCopybara-Service e37bedd344 Fix Halide BUILD rules
PiperOrigin-RevId: 547755467
2023-07-13 04:47:34 -07:00
MediaPipe TeamandCopybara-Service 251c5421f6 Internal change
PiperOrigin-RevId: 547735699
2023-07-13 02:53:16 -07:00
MediaPipe TeamandCopybara-Service 450c933cb5 MEDIAPIPE_NODE/SUBGRAPH_IMPLEMENTATION to use common define for registration
PiperOrigin-RevId: 547669538
2023-07-12 20:10:15 -07:00
MediaPipe TeamandCopybara-Service cc2aa4f4cc InferenceCalculatorAdvancedGL save cache in Open().
PiperOrigin-RevId: 547652481
2023-07-12 18:09:51 -07:00
MediaPipe TeamandCopybara-Service a2cd3e7f95 Internal change
PiperOrigin-RevId: 547614484
2023-07-12 15:17:40 -07:00
MediaPipe TeamandCopybara-Service 37b68714b8 Internal change
PiperOrigin-RevId: 547424721
2023-07-12 01:32:51 -07:00
MediaPipe TeamandCopybara-Service 3e93cbc838 Internal change
PiperOrigin-RevId: 547404737
2023-07-12 00:04:40 -07:00
MediaPipe TeamandCopybara-Service aabf61f28d Internal Change
PiperOrigin-RevId: 547299595
2023-07-11 14:35:18 -07:00
MediaPipe TeamandCopybara-Service 56bc019819 Model Maker allow core dataset library to handle datasets with unknown sizes.
PiperOrigin-RevId: 547268411
2023-07-11 12:47:37 -07:00
MediaPipe TeamandCopybara-Service 4788fddde9 Internal Change
PiperOrigin-RevId: 547265380
2023-07-11 12:34:32 -07:00
MediaPipe TeamandCopybara-Service e4ec4d2526 Internal change
PiperOrigin-RevId: 547258228
2023-07-11 12:05:58 -07:00
MediaPipe TeamandCopybara-Service bf6561ce91 add symmetric color style option
PiperOrigin-RevId: 547069284
2023-07-10 21:41:01 -07:00
MediaPipe TeamandCopybara-Service 0bde987a38 Removed internal dependency on OpenCV 3.x, migrating it to OpenCV 4.x
PiperOrigin-RevId: 546945166
2023-07-10 12:17:54 -07:00
MediaPipe TeamandCopybara-Service d45b15ef84 Add face landmarks connections for C++.
PiperOrigin-RevId: 546345842
2023-07-07 12:08:09 -07:00
MediaPipe TeamandCopybara-Service cb1035a9ee Internal change
PiperOrigin-RevId: 546090489
2023-07-06 14:24:31 -07:00
MediaPipe TeamandCopybara-Service 15ee1210e5 Internal change
PiperOrigin-RevId: 546035969
2023-07-06 10:58:20 -07:00
MediaPipe TeamandCopybara-Service 74f484d96d Internal change
PiperOrigin-RevId: 545658434
2023-07-05 07:09:40 -07:00
MediaPipe TeamandCopybara-Service dbe8e40124 Internal change
PiperOrigin-RevId: 545045282
2023-07-03 10:04:19 -07:00
MediaPipe TeamandCopybara-Service 7ba21e9a9a Revert Add location info in registry (debug mode only)
PiperOrigin-RevId: 544842663
2023-07-01 01:11:02 -07:00
MediaPipe TeamandCopybara-Service 422556c4a3 Internal change
PiperOrigin-RevId: 544663494
2023-06-30 08:34:32 -07:00
MediaPipe TeamandCopybara-Service 687075e5b8 Add gpu to cpu fallback for tensors_to_detections_calculator.
PiperOrigin-RevId: 544480883
2023-06-29 15:36:33 -07:00
MediaPipe TeamandCopybara-Service 0ea54b1461 Add delegate options to base options for java API. and add unit tset for BaseOptions.
PiperOrigin-RevId: 544458644
2023-06-29 14:13:46 -07:00
MediaPipe TeamandCopybara-Service e15d5a797b Do not send PreviousLoopback output packets to closed streams
PiperOrigin-RevId: 544449979
2023-06-29 13:44:56 -07:00
MediaPipe TeamandCopybara-Service 52cea59d41 Add keys for the context that better match the featurelist for text.
PiperOrigin-RevId: 544430289
2023-06-29 12:29:49 -07:00
MediaPipe TeamandCopybara-Service 0bb4ee8941 Add MobileNetV2_I320 and MobileNetMultiHWAVG_I384 to support larger input image sizes.
PiperOrigin-RevId: 544393692
2023-06-29 10:24:52 -07:00
MediaPipe TeamandCopybara-Service 8278dbc38f Exposes OpenCV photo lib.
PiperOrigin-RevId: 544092832
2023-06-28 10:22:07 -07:00
MediaPipe TeamandCopybara-Service 1ee55d1f1b Support ExBert training and option to select between AdamW and LAMB optimizers for BertClassifier
PiperOrigin-RevId: 543905014
2023-06-27 18:05:15 -07:00
MediaPipe TeamandCopybara-Service bed624f3b6 Shows the recently added warning when WaitUntilIdle is called with source nodes only once. Otherwise, it is very spammy as it's shown every frame. Moreover, display the names of the sources, so the warning is more actionable.
PiperOrigin-RevId: 543676454
2023-06-27 02:03:04 -07:00
MediaPipe TeamandCopybara-Service c8c5f3d062 Internal change
PiperOrigin-RevId: 543602625
2023-06-26 18:57:21 -07:00
MediaPipe TeamandCopybara-Service 9de1b2577f Internal update
PiperOrigin-RevId: 543508346
2023-06-26 12:26:51 -07:00
MediaPipe TeamandCopybara-Service 570880190b Internal change for proto library outputs.
PiperOrigin-RevId: 543368974
2023-06-26 01:52:50 -07:00
MediaPipe TeamandCopybara-Service a8899da45a Fix -Wsign-compare warning in api2/builder.h
PiperOrigin-RevId: 542673286
2023-06-22 14:49:23 -07:00
MediaPipe TeamandCopybara-Service 4e862995ba Fix typo
PiperOrigin-RevId: 542660548
2023-06-22 14:02:16 -07:00
MediaPipe TeamandCopybara-Service 2f5fc16a38 Fix timestamp computation when copying within first block.
When computing the last copied sample's timestamp, first_block_offset_ needs to be taken into account.

PiperOrigin-RevId: 542643291
2023-06-22 13:03:36 -07:00
MediaPipe TeamandCopybara-Service ba7e0e0e50 Add a face alignment preprocessor to face stylizer.
PiperOrigin-RevId: 542559764
2023-06-22 07:59:52 -07:00
MediaPipe TeamandCopybara-Service 825e3a8af0 Speed up TimeSeriesFramerCalculator.
Currently, TimeSeriesFramerCalculator constructs a distinct Matrix object for every input sample, which is inefficient. This CL revises buffering to keep each input packet's worth of samples as one grouped Matrix. A benchmark is added, showing a speed up of about 20x.

```
name                               old      new
BM_TimeSeriesFramerCalculator  48.45ms   2.26ms
```

PiperOrigin-RevId: 542462618
2023-06-21 23:03:54 -07:00
MediaPipe TeamandCopybara-Service 0d2548cd65 Internal change
PiperOrigin-RevId: 542392817
2023-06-21 16:23:43 -07:00